-- Logs begin at Wed 2022-07-27 15:32:45 UTC, end at Wed 2022-07-27 16:38:20 UTC. -- Jul 27 16:11:20.023347 dv-osbrick-849017-4-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 27 16:11:20.034329 dv-osbrick-849017-4-ceph devstack@keystone.service[87073]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 27 16:11:20.036516 dv-osbrick-849017-4-ceph devstack@keystone.service[87073]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 16:11:20 2022] *** Jul 27 16:11:20.036516 dv-osbrick-849017-4-ceph devstack@keystone.service[87073]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 16:11:20.036516 dv-osbrick-849017-4-ceph devstack@keystone.service[87073]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 16:11:20.036516 dv-osbrick-849017-4-ceph devstack@keystone.service[87073]: nodename: dv-osbrick-849017-4-ceph Jul 27 16:11:20.036516 dv-osbrick-849017-4-ceph devstack@keystone.service[87073]: machine: x86_64 Jul 27 16:11:20.036516 dv-osbrick-849017-4-ceph devstack@keystone.service[87073]: clock source: unix Jul 27 16:11:20.036516 dv-osbrick-849017-4-ceph devstack@keystone.service[87073]: pcre jit disabled Jul 27 16:11:20.036516 dv-osbrick-849017-4-ceph devstack@keystone.service[87073]: detected number of CPU cores: 4 Jul 27 16:11:20.036516 dv-osbrick-849017-4-ceph devstack@keystone.service[87073]: current working directory: / Jul 27 16:11:20.036516 dv-osbrick-849017-4-ceph devstack@keystone.service[87073]: detected binary path: /usr/bin/uwsgi-core Jul 27 16:11:20.037450 dv-osbrick-849017-4-ceph devstack@keystone.service[87073]: your processes number limit is 47680 Jul 27 16:11:20.037450 dv-osbrick-849017-4-ceph devstack@keystone.service[87073]: your memory page size is 4096 bytes Jul 27 16:11:20.037450 dv-osbrick-849017-4-ceph devstack@keystone.service[87073]: detected max file descriptor number: 2048 Jul 27 16:11:20.037450 dv-osbrick-849017-4-ceph devstack@keystone.service[87073]: lock engine: pthread robust mutexes Jul 27 16:11:20.037450 dv-osbrick-849017-4-ceph devstack@keystone.service[87073]: thunder lock: enabled Jul 27 16:11:20.037450 dv-osbrick-849017-4-ceph devstack@keystone.service[87073]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 27 16:11:20.037450 dv-osbrick-849017-4-ceph devstack@keystone.service[87073]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 16:11:20.080368 dv-osbrick-849017-4-ceph devstack@keystone.service[87073]: Python main interpreter initialized at 0x5562c30999c0 Jul 27 16:11:20.080368 dv-osbrick-849017-4-ceph devstack@keystone.service[87073]: python threads support enabled Jul 27 16:11:20.080368 dv-osbrick-849017-4-ceph devstack@keystone.service[87073]: your server socket listen backlog is limited to 100 connections Jul 27 16:11:20.080368 dv-osbrick-849017-4-ceph devstack@keystone.service[87073]: your mercy for graceful operations on workers is 90 seconds Jul 27 16:11:20.080713 dv-osbrick-849017-4-ceph devstack@keystone.service[87073]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 16:11:20.080788 dv-osbrick-849017-4-ceph devstack@keystone.service[87073]: *** Operational MODE: preforking *** Jul 27 16:11:20.081013 dv-osbrick-849017-4-ceph devstack@keystone.service[87073]: *** uWSGI is running in multiple interpreter mode *** Jul 27 16:11:20.081013 dv-osbrick-849017-4-ceph devstack@keystone.service[87073]: spawned uWSGI master process (pid: 87073) Jul 27 16:11:20.081216 dv-osbrick-849017-4-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 27 16:11:20.083241 dv-osbrick-849017-4-ceph devstack@keystone.service[87073]: spawned uWSGI worker 1 (pid: 87085, cores: 1) Jul 27 16:11:20.083241 dv-osbrick-849017-4-ceph devstack@keystone.service[87073]: spawned uWSGI worker 2 (pid: 87086, cores: 1) Jul 27 16:11:20.083241 dv-osbrick-849017-4-ceph devstack@keystone.service[87073]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 16:11:25.785893 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 16:11:25.785893 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: from cryptography.utils import int_from_bytes Jul 27 16:11:25.786689 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 16:11:25.786689 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: from cryptography.utils import int_from_bytes Jul 27 16:11:25.787614 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 16:11:25.787614 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: from cryptography.utils import int_from_bytes Jul 27 16:11:25.788091 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 16:11:25.788091 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: from cryptography.utils import int_from_bytes Jul 27 16:11:25.835333 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 16:11:25.835523 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 16:11:25.835720 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] command line args: [] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 16:11:25.835830 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 16:11:25.835986 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 16:11:25.836066 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 16:11:25.836170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ================================================================================ {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 16:11:25.836303 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] command line args: [] {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 16:11:25.836421 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] admin_token = **** {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.836516 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 16:11:25.836625 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ================================================================================ {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 16:11:25.836710 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] config_dir = [] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.836836 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.836913 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] admin_token = **** {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.837018 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] config_source = [] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.837106 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] config_dir = [] {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.837203 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] debug = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.837287 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.837401 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.837642 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] config_source = [] {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.837642 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] debug = True {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.837765 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.837828 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.837915 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.838060 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.838172 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.838286 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.838386 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.838480 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.838616 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] list_limit = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.838719 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.838830 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] log_config_append = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.838931 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] list_limit = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.839025 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.839122 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] log_config_append = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.839228 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] log_dir = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.839327 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.839478 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] log_file = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.839587 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] log_dir = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.839694 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.839774 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] log_file = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.839895 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.839969 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.840093 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.840173 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.840287 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.840369 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.840445 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.840567 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.840654 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.840736 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.840858 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.840933 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.841046 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.841128 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.841231 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.841315 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.841462 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.841539 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.841692 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.841778 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.841923 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.842012 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.842167 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.842250 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.842409 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.842500 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.843198 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.843288 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.843541 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.843710 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.843891 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] publish_errors = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.844052 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.844134 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.844283 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] publish_errors = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.844409 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.844501 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.844617 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.844698 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.844775 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.844902 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.844994 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.845098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.845176 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] standard_threads = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.845337 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.845423 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.845574 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] standard_threads = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.845652 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.845773 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.845880 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.845969 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] use_journal = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.846049 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.846122 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] use_json = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.846192 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.846262 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] use_stderr = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.846369 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] use_journal = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.846470 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] use_syslog = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.846533 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] use_json = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.846678 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.846819 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] use_stderr = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.846952 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] use_syslog = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.847077 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.847210 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:11:25.847336 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.847484 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.847611 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.847869 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.848007 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.848144 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.848271 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.848403 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.848536 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.848663 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.848779 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.848779 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.848926 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.848997 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.849071 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.849071 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.849202 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.849280 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.849351 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.849443 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.849519 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.849687 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.849765 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.849922 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.849999 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.850164 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.850240 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.850401 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.850477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.850624 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.850696 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.850870 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.850947 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.851112 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.851198 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.851351 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.851489 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.851618 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.851704 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.851866 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.851943 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.852104 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.852181 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.852361 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.852437 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.852606 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.852691 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.852834 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.852917 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.853059 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.853285 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.853389 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.853517 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.853737 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.853821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.853990 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.854122 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.854205 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.854435 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.854511 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.854686 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.854763 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.854930 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.855013 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.855166 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.855249 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.855434 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.855517 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.855665 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.855753 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.855897 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.855976 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.856130 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.856207 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.856358 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.856435 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.856582 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.856661 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.856802 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.856884 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.857029 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.857105 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.857263 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.857341 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.857508 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.857585 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.857736 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.857813 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.857968 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.858044 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.858218 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.858807 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.859031 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.859115 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.859268 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.859347 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.859527 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.859605 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.859759 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.859844 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.859989 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.860066 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.860223 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.860300 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.860481 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.860596 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.860679 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.860749 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.860911 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.860990 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.861139 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.861217 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.861376 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.861453 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.861607 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.861683 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.861838 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.861924 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.862066 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.862156 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.862302 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.862387 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.862543 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.862620 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.862769 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.862855 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.863007 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.863118 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.863235 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.863328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.863521 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.863616 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.863758 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.863839 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.863987 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.864066 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.864229 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.864324 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.864461 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.864547 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.864703 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.864783 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.864936 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.865024 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.865179 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.865259 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.865412 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.865492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.865669 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.865799 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.865880 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.865952 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.866103 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.866189 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.866336 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.866424 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.866566 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.866646 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.866798 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.866879 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.867030 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.867119 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.867267 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.867345 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.867531 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.867612 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.867768 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.867865 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.868002 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.868081 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.868235 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.868313 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.868466 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.868624 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.868701 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.868780 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.868933 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.869022 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.869160 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.869254 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.869385 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.869539 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.869620 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.869782 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.869868 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.870025 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.870113 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.870266 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.870346 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.870497 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.870575 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.870729 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.870815 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.870962 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.871041 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.871198 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.871329 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.871445 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.871615 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.871697 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.871855 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.871941 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.872085 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] auth.external = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.872173 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.872314 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.872394 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.872611 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.872692 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.872842 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.872921 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.873073 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] auth.password = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.873154 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.873303 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] auth.token = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.873392 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] auth.external = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.873541 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.873621 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.873797 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.873883 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.874043 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.874125 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.874273 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.874351 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] auth.password = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.874519 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.874609 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] auth.token = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.874764 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.874846 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.874993 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.875073 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.875227 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] credential.caching = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.875307 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.875484 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.875567 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.875729 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.875809 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.875974 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.876054 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.876209 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.876292 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.876447 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] credential.caching = True {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.876525 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.876677 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.876756 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.876936 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.877017 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.877185 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.877267 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.877419 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.877506 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.877663 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.877742 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.877901 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.877982 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.878173 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.878252 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.878427 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.878512 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.878664 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.878743 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.878916 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.878996 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.879147 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] federation.caching = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.879226 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.879396 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.879494 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.879646 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.879728 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.879898 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.879985 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.880125 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.880206 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.880368 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.880449 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] federation.caching = True {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.880601 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.880683 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.880848 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.880929 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.881083 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.881164 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.881332 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.881414 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.881566 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.881646 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.881802 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.881889 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.882031 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity.caching = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.882110 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.882276 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.882356 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.882518 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.882674 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.882751 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.882823 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.882977 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.883064 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.883222 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.883310 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] identity.caching = True {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.884851 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.884990 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.884990 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.885250 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.885385 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.885385 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.885641 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.885788 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.885788 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.886036 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.886036 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.886036 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.886036 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.886036 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.886036 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.886420 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.886491 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.886571 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.886645 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.886829 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.886908 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.886981 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.887053 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.887134 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.887209 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.887320 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.887424 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.887596 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.887677 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.887835 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.887918 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.888066 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.888147 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.888300 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.888381 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.888538 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.888619 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.888775 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.888858 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.889026 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.889110 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.889255 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.889336 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.890011 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.890094 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.890255 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.890336 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.890490 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.890571 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.890734 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.890815 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.890982 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.891088 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.891206 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.891295 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.891466 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.891551 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.891696 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.891775 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.891932 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.892013 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.892191 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.892282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.892403 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.892482 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.892637 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.892718 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.892873 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.892958 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.893159 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.893236 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.893318 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.893392 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.893553 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.893650 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.893779 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.893866 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.894022 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.894103 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.894262 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.894341 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.894563 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.894667 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.894743 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.894814 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.894945 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.895025 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.895172 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.895259 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.895427 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.895516 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.895672 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.895759 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.895903 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.895999 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.896144 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.896225 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.896385 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.896463 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.896623 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.896710 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.896852 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.896930 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.897079 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.897158 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.user = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.897311 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.897398 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.897541 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.897620 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.897774 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.897853 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.898000 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.898087 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.898242 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.898323 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.898483 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.898562 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.898723 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.898810 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.898953 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.899032 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.899194 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.899273 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.899441 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.899533 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.899687 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.899765 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.899919 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.899996 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.900162 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.900250 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.900396 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.900476 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.900629 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.900707 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.900874 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.900962 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.901113 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.901192 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.901345 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.901423 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.901594 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.901680 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.901822 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.901901 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.902061 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.902139 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.902294 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.902379 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.902525 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.902605 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.902760 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.902839 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.903008 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.903094 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.903245 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.903323 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.903512 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.903594 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.903750 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.903847 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.903985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] resource.caching = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.904063 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.904224 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.904308 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.904463 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.904550 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.904693 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.904777 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.904938 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.905016 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.905747 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.905838 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.905982 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.906062 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.906225 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.906304 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.906459 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.906545 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] resource.caching = True {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.906692 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.906772 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.906922 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] role.caching = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.907002 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.907164 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] role.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.907319 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.907430 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.907506 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.907680 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.907761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.907923 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.908016 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.908172 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.908251 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.908413 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.908492 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.908653 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.908734 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.908892 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] role.caching = True {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.908977 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.909133 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.909214 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] role.driver = sql {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.909376 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.909454 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.909848 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.909933 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.910097 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.910176 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.910341 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.910421 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.910583 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.910662 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.910826 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.910905 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.911073 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.911249 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.911329 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.911520 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.911602 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.911770 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.911862 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.912017 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.912096 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.912270 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.912404 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.912530 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.912683 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.912821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.912952 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.913078 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.913202 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.913325 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.913460 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.913582 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.913706 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.913837 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.913970 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.914096 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.914096 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.914340 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.914464 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.914587 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.914587 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.914832 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.914832 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.915067 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.915191 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.915314 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.915495 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.915641 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.915773 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.915893 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.916020 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] token.caching = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.916150 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.916279 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.916414 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.916543 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.916671 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.916799 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.916923 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.917050 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.917186 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.917315 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.917452 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.917581 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.917709 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.917836 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.917971 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.918099 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.918228 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] token.caching = True {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.918356 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.918484 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.918612 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.918747 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.918875 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.919002 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.919130 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.919311 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.919470 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.919561 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.919636 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.919707 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.919778 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.919848 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.919919 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.919997 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.920070 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.920144 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.920215 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.connection = **** {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.920294 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.920375 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.920448 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.920526 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.920599 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.920697 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.920770 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.920831 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.920950 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.921072 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.921185 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.921310 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.921433 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.921546 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.921731 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.921818 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.921994 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] database.connection = **** {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.922082 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.922241 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.922322 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.922480 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.922558 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.922714 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.922810 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.922956 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.923041 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.923187 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.923266 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.923454 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.923551 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.923682 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.923761 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.923919 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.923998 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.924152 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.924240 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.924314 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 16:11:25.924385 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.924638 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.924880 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.925131 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.925371 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.925621 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.925857 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.926102 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.926341 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:11:25.926512 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 16:11:25.954085 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:25.954310 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:25.954535 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:25.955314 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:25.955585 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:25.955820 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:25.962892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:25.965804 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:25.992580 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:25.992801 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:25.994192 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:25.994428 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.045307 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.046277 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.096362 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.096637 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.098653 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.099053 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.162236 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.162420 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.162542 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.162624 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.162699 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.162805 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.162891 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.163031 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.163125 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.163275 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.163416 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.163499 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.186394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.186548 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.186637 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.186787 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.186872 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.187016 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.187108 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.187235 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.187402 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.187485 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.187563 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.187677 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.187775 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.187897 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.198703 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.198994 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.211982 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.212204 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.212427 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.212647 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.212730 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.212865 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.212958 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.213079 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.213225 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.213349 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.213428 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.213531 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.213752 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.213973 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:11:26.230662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.230856 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.230942 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 16:11:26.231069 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 16:11:26.231190 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.231412 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 16:11:26.231496 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.231625 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 16:11:26.231720 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.231897 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.231984 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.232161 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.232241 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.232410 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.232497 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.232661 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.242057 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.242322 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.242414 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.242583 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.242687 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.242857 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.242944 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.243527 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.251594 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.252038 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.254505 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.254787 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.254964 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.255050 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.255252 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.255337 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.255576 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.255662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.255866 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.255962 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.256171 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.256263 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.256397 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.256478 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.256662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.256752 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.256935 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.257026 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.257196 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.257267 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.257485 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.257759 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.280906 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.282039 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.282384 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.282662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.283565 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.283850 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.287529 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.287806 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.288083 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.288821 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.289107 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.289394 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.294621 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.294902 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.296051 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.296336 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.298955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.299244 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.299558 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.299840 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.300228 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.300371 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.300499 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.300659 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.300780 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.300945 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.301063 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.301228 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.301617 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.301891 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.302164 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.302432 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.317209 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.317484 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.318513 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.318791 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.321368 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.322652 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.324494 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.324790 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.325775 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.326078 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.330252 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.331289 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.334369 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.335523 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.338474 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.338769 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.339048 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.339331 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.339746 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.339858 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.340018 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.340270 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.340648 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.340946 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.341338 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.341637 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.357710 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.357996 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.358088 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.358797 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.358917 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.359073 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.359189 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.359487 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.366029 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.366396 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.367778 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.368047 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.368250 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.368535 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.370708 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.370991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.371222 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.371309 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.371527 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.371626 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.371830 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.371913 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.372213 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.372668 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.383132 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.383432 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.383727 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.383985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.384258 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.384527 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.384801 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.389767 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.390049 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.390330 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.390610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.390889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.391166 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.391466 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.400239 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.403305 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.407556 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.407991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.409456 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.410789 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.411206 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.411512 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.411794 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.414861 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.416387 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.417936 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.418217 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.418504 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.520749 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.522176 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.525053 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.525340 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.525620 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.525891 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.526808 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.528354 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.531819 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.532111 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.532399 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.532680 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.534324 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.534610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.535154 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.540902 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.541196 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.541480 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.541903 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.542294 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.542576 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.542861 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.543130 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.543427 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.543701 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.543976 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.544255 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.544521 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.544788 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.545054 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.545316 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.545572 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.548884 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:11:26.549283 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.549583 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.549861 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.550140 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.550426 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.550707 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.550981 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.551258 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.551565 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.551839 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.552108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.552377 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.552638 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:11:26.578985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5562c30999c0 pid: 87085 (default app) Jul 27 16:11:26.582645 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6beb4e7-c78c-448e-9308-71d701827064 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:26.582936 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6beb4e7-c78c-448e-9308-71d701827064 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:26.583213 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6beb4e7-c78c-448e-9308-71d701827064 None None] PATH_INFO: `/v3` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:26.585838 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5562c30999c0 pid: 87086 (default app) Jul 27 16:11:26.587463 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 791 bytes} [Wed Jul 27 16:11:26 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:11:34.658604 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df86d82-4b1b-4e4a-8b30-f03801281c6e None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:34.659179 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df86d82-4b1b-4e4a-8b30-f03801281c6e None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:34.659179 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df86d82-4b1b-4e4a-8b30-f03801281c6e None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:34.663819 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 1/2] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:11:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:11:34.669205 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc4419-555e-4f16-b522-84ba1f26b4fe None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:34.669657 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc4419-555e-4f16-b522-84ba1f26b4fe None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:34.670200 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc4419-555e-4f16-b522-84ba1f26b4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:34.747136 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: INFO dbcounter [None req-04cc4419-555e-4f16-b522-84ba1f26b4fe None None] Registered counter for database keystone Jul 27 16:11:34.769397 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG oslo_db.sqlalchemy.engines [None req-04cc4419-555e-4f16-b522-84ba1f26b4fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87085) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 16:11:34.775470 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writer thread running {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 16:11:34.953620 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG passlib.handlers.bcrypt [None req-04cc4419-555e-4f16-b522-84ba1f26b4fe None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87085) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 27 16:11:34.953961 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG passlib.handlers.bcrypt [None req-04cc4419-555e-4f16-b522-84ba1f26b4fe None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87085) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 27 16:11:35.009351 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-04cc4419-555e-4f16-b522-84ba1f26b4fe None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:11:35.010942 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-04cc4419-555e-4f16-b522-84ba1f26b4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:11:35.136062 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 2/3] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:11:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 27 16:11:35.304372 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df86d82-4b1b-4e4a-8b30-f03801281c6e None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:35.380575 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: INFO dbcounter [None req-2df86d82-4b1b-4e4a-8b30-f03801281c6e None None] Registered counter for database keystone Jul 27 16:11:35.399918 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG oslo_db.sqlalchemy.engines [None req-2df86d82-4b1b-4e4a-8b30-f03801281c6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87086) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 16:11:35.406663 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writer thread running {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 16:11:35.529354 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df86d82-4b1b-4e4a-8b30-f03801281c6e None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:35.534314 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5758e-7bd3-4fd6-b0f8-4e23b7093ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:35.534957 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5758e-7bd3-4fd6-b0f8-4e23b7093ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:35.535560 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5758e-7bd3-4fd6-b0f8-4e23b7093ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:35.535818 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5758e-7bd3-4fd6-b0f8-4e23b7093ec8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:35.544736 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5758e-7bd3-4fd6-b0f8-4e23b7093ec8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:35.597892 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d5f5758e-7bd3-4fd6-b0f8-4e23b7093ec8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 27 16:11:35.598155 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5758e-7bd3-4fd6-b0f8-4e23b7093ec8 admin admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:35.609111 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 2/4] 10.222.0.65 () {58 vars in 1324 bytes} [Wed Jul 27 16:11:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 16:11:35.615631 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc4419-555e-4f16-b522-84ba1f26b4fe None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:35.630425 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc4419-555e-4f16-b522-84ba1f26b4fe None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:35.634965 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c1982-3662-42ce-b322-d7e35ee56942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:35.636148 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c1982-3662-42ce-b322-d7e35ee56942 admin admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:35.636439 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c1982-3662-42ce-b322-d7e35ee56942 admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:35.636718 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c1982-3662-42ce-b322-d7e35ee56942 admin admin] PATH_INFO: `/v3/projects/4e89005d4d794906addd0b11c7e81008` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:35.638243 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c1982-3662-42ce-b322-d7e35ee56942 admin admin] RBAC: Authorizing `identity:get_project(project_id=4e89005d4d794906addd0b11c7e81008)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:35.689359 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4d0c1982-3662-42ce-b322-d7e35ee56942 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 27 16:11:35.689917 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c1982-3662-42ce-b322-d7e35ee56942 admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:35.694513 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 3/5] 10.222.0.65 () {56 vars in 1207 bytes} [Wed Jul 27 16:11:35 2022] GET /identity/v3/projects/4e89005d4d794906addd0b11c7e81008 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:11:38.003918 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d18bde-c41c-4090-8a84-e5e8ab3d131d None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:38.004442 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d18bde-c41c-4090-8a84-e5e8ab3d131d None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:38.004442 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d18bde-c41c-4090-8a84-e5e8ab3d131d None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:38.008533 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 3/6] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:11:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:11:38.013956 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5c1db-ee40-45ef-993f-216efd81fe05 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:38.014364 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5c1db-ee40-45ef-993f-216efd81fe05 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:38.014528 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5c1db-ee40-45ef-993f-216efd81fe05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:38.034349 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-53a5c1db-ee40-45ef-993f-216efd81fe05 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:11:38.036133 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-53a5c1db-ee40-45ef-993f-216efd81fe05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:11:38.044576 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 4/7] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:11:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 27 16:11:38.068356 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d18bde-c41c-4090-8a84-e5e8ab3d131d None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:38.080912 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d18bde-c41c-4090-8a84-e5e8ab3d131d None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:38.085367 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8cd0c-f147-4e83-a812-911848e06f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:38.085992 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8cd0c-f147-4e83-a812-911848e06f26 admin admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:38.086281 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8cd0c-f147-4e83-a812-911848e06f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:38.086560 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8cd0c-f147-4e83-a812-911848e06f26 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:38.094483 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8cd0c-f147-4e83-a812-911848e06f26 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:38.096305 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8cd0c-f147-4e83-a812-911848e06f26 admin admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:38.105159 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 4/8] 10.222.0.65 () {58 vars in 1324 bytes} [Wed Jul 27 16:11:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 16:11:38.111024 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5c1db-ee40-45ef-993f-216efd81fe05 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:38.120123 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5c1db-ee40-45ef-993f-216efd81fe05 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:38.125083 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d12aa-e27c-4813-9ddc-e48339d46c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:38.125718 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d12aa-e27c-4813-9ddc-e48339d46c0f admin admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:38.126003 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d12aa-e27c-4813-9ddc-e48339d46c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:38.126282 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d12aa-e27c-4813-9ddc-e48339d46c0f admin admin] PATH_INFO: `/v3/users/30d80e0d318d4f78a4aac8c796957981` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:38.127681 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d12aa-e27c-4813-9ddc-e48339d46c0f admin admin] RBAC: Authorizing `identity:get_user(user_id=30d80e0d318d4f78a4aac8c796957981)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:38.129515 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d12aa-e27c-4813-9ddc-e48339d46c0f admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:38.131083 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 5/9] 10.222.0.65 () {56 vars in 1198 bytes} [Wed Jul 27 16:11:38 2022] GET /identity/v3/users/30d80e0d318d4f78a4aac8c796957981 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:11:40.422923 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b255c25-3777-4a8c-8662-21b7bc69688a None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:40.423495 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b255c25-3777-4a8c-8662-21b7bc69688a None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:40.423593 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b255c25-3777-4a8c-8662-21b7bc69688a None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:40.423796 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca7eef-7596-4e6e-81b5-020d13c18c87 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:40.424166 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca7eef-7596-4e6e-81b5-020d13c18c87 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:40.424364 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca7eef-7596-4e6e-81b5-020d13c18c87 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:40.424955 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 5/10] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:11:40.425690 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 6/11] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:11:40.430296 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a90593-2c81-406d-b1aa-a7c475165fed None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:40.430589 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a90593-2c81-406d-b1aa-a7c475165fed None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:40.430680 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de405c48-6722-4a27-9bfd-0af067b81e95 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:40.430876 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a90593-2c81-406d-b1aa-a7c475165fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:40.430962 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de405c48-6722-4a27-9bfd-0af067b81e95 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:40.431244 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de405c48-6722-4a27-9bfd-0af067b81e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:40.451567 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-de405c48-6722-4a27-9bfd-0af067b81e95 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:11:40.453293 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-de405c48-6722-4a27-9bfd-0af067b81e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:11:40.483875 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG passlib.handlers.bcrypt [None req-68a90593-2c81-406d-b1aa-a7c475165fed None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87086) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 27 16:11:40.484353 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG passlib.handlers.bcrypt [None req-68a90593-2c81-406d-b1aa-a7c475165fed None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87086) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 27 16:11:40.530760 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-68a90593-2c81-406d-b1aa-a7c475165fed None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:11:40.532433 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-68a90593-2c81-406d-b1aa-a7c475165fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:11:40.541614 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 7/12] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:11:40.566016 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de405c48-6722-4a27-9bfd-0af067b81e95 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:40.589989 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:40.634728 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 6/13] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:11:40.657991 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a90593-2c81-406d-b1aa-a7c475165fed None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:40.670974 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de405c48-6722-4a27-9bfd-0af067b81e95 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:40.706428 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3cd6d-20f0-4d98-851f-6781a4d31af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:40.707011 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3cd6d-20f0-4d98-851f-6781a4d31af2 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:40.707292 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3cd6d-20f0-4d98-851f-6781a4d31af2 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:40.707604 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3cd6d-20f0-4d98-851f-6781a4d31af2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:40.719706 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc3cd6d-20f0-4d98-851f-6781a4d31af2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:11:40.729797 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-6fc3cd6d-20f0-4d98-851f-6781a4d31af2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:11:40.729797 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:11:40.729797 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:11:40.729797 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:11:40.729797 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:11:40.729797 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:11:40.729797 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:11:40.729797 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:11:40.729797 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:11:40.729797 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:11:40.729797 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:11:40.729797 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:11:40.729797 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:11:40.729797 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:11:40.729797 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:11:40.729797 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:11:40.730757 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:11:40.730757 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:11:40.730757 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:11:40.730757 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:11:40.730757 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:11:40.730757 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:11:40.730757 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:11:40.730757 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:11:40.730757 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:11:40.730757 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:11:40.730757 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:11:40.730757 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:11:40.730757 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:11:40.730757 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:11:40.730757 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:11:40.730757 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:11:40.731627 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:11:40.731627 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:11:40.731627 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:11:40.731627 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:11:40.731627 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:11:40.731627 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:11:40.731627 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:11:40.731627 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:11:40.731627 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:11:40.731627 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:11:40.731627 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:11:40.731627 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:11:40.731627 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 8/14] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 16:11:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:11:40.736905 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3cd6d-20f0-4d98-851f-6781a4d31af2 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:40.767505 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a90593-2c81-406d-b1aa-a7c475165fed None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:40.769892 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:40.807672 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09caa148-0e12-4790-aef8-466cb057a112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:40.808556 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09caa148-0e12-4790-aef8-466cb057a112 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:40.808841 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09caa148-0e12-4790-aef8-466cb057a112 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:40.809121 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09caa148-0e12-4790-aef8-466cb057a112 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:40.822602 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:40.842802 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3cd6d-20f0-4d98-851f-6781a4d31af2 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:40.877272 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c72b3e-2089-4ec4-9b11-00735f0ba41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:40.877906 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c72b3e-2089-4ec4-9b11-00735f0ba41e None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:40.878197 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c72b3e-2089-4ec4-9b11-00735f0ba41e None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:40.878479 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c72b3e-2089-4ec4-9b11-00735f0ba41e None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:40.879109 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09caa148-0e12-4790-aef8-466cb057a112 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:40.879200 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c72b3e-2089-4ec4-9b11-00735f0ba41e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:11:40.879539 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c72b3e-2089-4ec4-9b11-00735f0ba41e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:40.880695 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09caa148-0e12-4790-aef8-466cb057a112 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:40.880943 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c72b3e-2089-4ec4-9b11-00735f0ba41e None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:40.893484 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 9/15] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:11:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:11:40.899165 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c72b3e-2089-4ec4-9b11-00735f0ba41e None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:40.983875 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 7/16] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:11:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 16:11:40.989416 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09caa148-0e12-4790-aef8-466cb057a112 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:40.992203 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:41.003573 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c72b3e-2089-4ec4-9b11-00735f0ba41e None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:41.038386 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6bf51-25f6-42f7-aa6c-48436f5d1963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:41.039040 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6bf51-25f6-42f7-aa6c-48436f5d1963 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:41.039332 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6bf51-25f6-42f7-aa6c-48436f5d1963 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:41.039650 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6bf51-25f6-42f7-aa6c-48436f5d1963 None admin] PATH_INFO: `/v3/users/30d80e0d318d4f78a4aac8c796957981` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:41.041057 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6bf51-25f6-42f7-aa6c-48436f5d1963 None admin] RBAC: Authorizing `identity:get_user(user_id=30d80e0d318d4f78a4aac8c796957981)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:41.042538 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6bf51-25f6-42f7-aa6c-48436f5d1963 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:41.044349 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 10/17] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:11:40 2022] GET /identity/v3/users/30d80e0d318d4f78a4aac8c796957981 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:11:41.049709 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6bf51-25f6-42f7-aa6c-48436f5d1963 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:41.063978 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:41.093576 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09caa148-0e12-4790-aef8-466cb057a112 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:41.127262 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d753508-3be6-4180-b60d-ca871a769b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:41.128159 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d753508-3be6-4180-b60d-ca871a769b9d None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:41.128446 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d753508-3be6-4180-b60d-ca871a769b9d None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:41.128848 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d753508-3be6-4180-b60d-ca871a769b9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:41.149113 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d753508-3be6-4180-b60d-ca871a769b9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:41.149670 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6bf51-25f6-42f7-aa6c-48436f5d1963 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:41.150586 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d753508-3be6-4180-b60d-ca871a769b9d None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:41.168974 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-9d753508-3be6-4180-b60d-ca871a769b9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:11:41.168974 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:11:41.168974 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:11:41.168974 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:11:41.168974 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:11:41.168974 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:11:41.168974 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:11:41.168974 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:11:41.168974 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:11:41.168974 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:11:41.168974 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:11:41.168974 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:11:41.168974 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:11:41.168974 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:11:41.168974 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:11:41.169823 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:11:41.169823 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:11:41.169823 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:11:41.169823 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:11:41.169823 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:11:41.169823 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:11:41.169823 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:11:41.169823 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:11:41.169823 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:11:41.169823 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:11:41.169823 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:11:41.169823 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:11:41.169823 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:11:41.169823 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:11:41.169823 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:11:41.169823 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:11:41.169823 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:11:41.170652 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:11:41.170652 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:11:41.170652 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:11:41.170652 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:11:41.170652 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 8/18] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:11:41.176804 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d753508-3be6-4180-b60d-ca871a769b9d None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:41.184846 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1453f3a-a3e8-428e-bddf-031791272a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:41.185499 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1453f3a-a3e8-428e-bddf-031791272a2a None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:41.185786 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1453f3a-a3e8-428e-bddf-031791272a2a None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:41.186064 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1453f3a-a3e8-428e-bddf-031791272a2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:41.187285 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1453f3a-a3e8-428e-bddf-031791272a2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:41.188774 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1453f3a-a3e8-428e-bddf-031791272a2a None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:41.190349 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 11/19] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:11:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:11:41.196104 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1453f3a-a3e8-428e-bddf-031791272a2a None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:41.232318 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:41.277859 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d753508-3be6-4180-b60d-ca871a769b9d None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:41.278856 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:41.298452 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1453f3a-a3e8-428e-bddf-031791272a2a None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:41.316335 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea67323-8375-4e94-95fa-269d16aed2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:41.316990 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea67323-8375-4e94-95fa-269d16aed2f5 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:41.317244 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea67323-8375-4e94-95fa-269d16aed2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:41.317519 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea67323-8375-4e94-95fa-269d16aed2f5 None admin] PATH_INFO: `/v3/domains` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:41.318209 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea67323-8375-4e94-95fa-269d16aed2f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:11:41.318519 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea67323-8375-4e94-95fa-269d16aed2f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:41.319962 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea67323-8375-4e94-95fa-269d16aed2f5 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:41.331779 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afafa1-32ce-4508-9f59-2b61155dc410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:41.332538 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afafa1-32ce-4508-9f59-2b61155dc410 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:41.332691 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afafa1-32ce-4508-9f59-2b61155dc410 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:41.332908 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afafa1-32ce-4508-9f59-2b61155dc410 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:41.333770 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afafa1-32ce-4508-9f59-2b61155dc410 None admin] RBAC: Adding query filter params (role.id=76e01abae9964dd5b28fc8895f739ee4, scope.domain.id=default, user.id=30d80e0d318d4f78a4aac8c796957981) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:11:41.333997 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afafa1-32ce-4508-9f59-2b61155dc410 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:41.335467 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afafa1-32ce-4508-9f59-2b61155dc410 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:41.337579 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 9/20] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:11:41.342452 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 12/21] 10.222.0.65 () {56 vars in 1322 bytes} [Wed Jul 27 16:11:41 2022] GET /identity/v3/role_assignments?user.id=30d80e0d318d4f78a4aac8c796957981&scope.domain.id=default&role.id=76e01abae9964dd5b28fc8895f739ee4 => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:11:44.111706 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f906c-0e2b-47ac-b9f5-24c067c7c7c9 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:44.112216 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f906c-0e2b-47ac-b9f5-24c067c7c7c9 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:44.112289 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f906c-0e2b-47ac-b9f5-24c067c7c7c9 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:44.113617 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 10/22] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:11:44.119494 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de99a2-44bd-4bf6-80f1-5440406f777d None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:44.120010 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de99a2-44bd-4bf6-80f1-5440406f777d None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:44.120083 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de99a2-44bd-4bf6-80f1-5440406f777d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:44.149641 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-d0de99a2-44bd-4bf6-80f1-5440406f777d None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:11:44.150889 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-d0de99a2-44bd-4bf6-80f1-5440406f777d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:11:44.243343 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 13/23] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:11:44.278930 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f906c-0e2b-47ac-b9f5-24c067c7c7c9 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:44.316560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4e481-c1a2-40b4-8447-6d570cfa492f None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:44.317200 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4e481-c1a2-40b4-8447-6d570cfa492f None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:44.317680 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4e481-c1a2-40b4-8447-6d570cfa492f None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:44.319256 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 14/24] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:11:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:11:44.324450 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643a65f-40a3-4e07-99ec-e56bf052cbb9 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:44.325059 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643a65f-40a3-4e07-99ec-e56bf052cbb9 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:44.325536 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643a65f-40a3-4e07-99ec-e56bf052cbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:44.371109 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-d643a65f-40a3-4e07-99ec-e56bf052cbb9 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:11:44.372789 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-d643a65f-40a3-4e07-99ec-e56bf052cbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:11:44.475472 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 15/25] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:11:44.477545 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4feea0-b822-432c-8ddb-73e7e799153e None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:44.478310 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4feea0-b822-432c-8ddb-73e7e799153e None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:44.478795 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4feea0-b822-432c-8ddb-73e7e799153e None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:44.480388 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 16/26] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:11:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:11:44.486499 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bbb54-83f9-40a7-930c-b1c2eedd9c5e None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:44.489671 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bbb54-83f9-40a7-930c-b1c2eedd9c5e None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:44.490413 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bbb54-83f9-40a7-930c-b1c2eedd9c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:44.509039 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f906c-0e2b-47ac-b9f5-24c067c7c7c9 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:44.512120 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:44.539253 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-577bbb54-83f9-40a7-930c-b1c2eedd9c5e None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:11:44.541301 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-577bbb54-83f9-40a7-930c-b1c2eedd9c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:11:44.549311 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:44.584172 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a8825-71e2-421e-a831-db0a8730be1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:44.584846 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a8825-71e2-421e-a831-db0a8730be1a None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:44.585135 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a8825-71e2-421e-a831-db0a8730be1a None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:44.585462 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a8825-71e2-421e-a831-db0a8730be1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:44.604385 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a8825-71e2-421e-a831-db0a8730be1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:11:44.615610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-9f0a8825-71e2-421e-a831-db0a8730be1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:11:44.615610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:11:44.615610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:11:44.615610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:11:44.615610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:11:44.615610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:11:44.615610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:11:44.615610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:11:44.615610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:11:44.615610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:11:44.615610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:11:44.615610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:11:44.615610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:11:44.615610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:11:44.615610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:11:44.615610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:11:44.616474 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:11:44.616474 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:11:44.616474 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:11:44.616474 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:11:44.616474 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:11:44.616474 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:11:44.616474 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:11:44.616474 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:11:44.616474 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:11:44.616474 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:11:44.616474 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:11:44.616474 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:11:44.616474 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:11:44.616474 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:11:44.616474 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:11:44.616474 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:11:44.617206 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:11:44.617206 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:11:44.617206 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:11:44.617206 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:11:44.617206 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:11:44.617206 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:11:44.617206 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:11:44.617206 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:11:44.617206 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:11:44.617206 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:11:44.617206 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:11:44.617206 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:11:44.620802 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 11/27] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 16:11:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:11:44.621653 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a8825-71e2-421e-a831-db0a8730be1a None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:44.677582 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 17/28] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:11:44.678683 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06947e-8b7f-437b-bd98-e3c74a020a06 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:44.678976 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06947e-8b7f-437b-bd98-e3c74a020a06 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:44.679256 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06947e-8b7f-437b-bd98-e3c74a020a06 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:44.680746 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 18/29] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:11:44.681229 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06947e-8b7f-437b-bd98-e3c74a020a06 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:44.844355 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a8825-71e2-421e-a831-db0a8730be1a None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:44.899931 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06947e-8b7f-437b-bd98-e3c74a020a06 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:44.914234 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8065aef-ae86-42a3-af40-f21efd983530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:44.918351 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8065aef-ae86-42a3-af40-f21efd983530 None admin] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:44.919184 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8065aef-ae86-42a3-af40-f21efd983530 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:44.920021 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8065aef-ae86-42a3-af40-f21efd983530 None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:44.921030 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8065aef-ae86-42a3-af40-f21efd983530 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:44.922676 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8065aef-ae86-42a3-af40-f21efd983530 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:44.942266 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2942b9-d7bc-41d4-aacc-4fc6a6df5ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:44.948298 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2942b9-d7bc-41d4-aacc-4fc6a6df5ba6 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:44.949296 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2942b9-d7bc-41d4-aacc-4fc6a6df5ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:44.950828 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2942b9-d7bc-41d4-aacc-4fc6a6df5ba6 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:44.952763 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2942b9-d7bc-41d4-aacc-4fc6a6df5ba6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:11:44.953507 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2942b9-d7bc-41d4-aacc-4fc6a6df5ba6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:44.956547 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2942b9-d7bc-41d4-aacc-4fc6a6df5ba6 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:44.959810 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:44.970915 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 19/30] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:11:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:11:44.972678 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b8521-a642-42ca-a145-33041f05c27b None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:44.973243 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b8521-a642-42ca-a145-33041f05c27b None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:44.973709 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b8521-a642-42ca-a145-33041f05c27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:44.993908 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-918b8521-a642-42ca-a145-33041f05c27b None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:11:44.995671 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-918b8521-a642-42ca-a145-33041f05c27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:11:45.073576 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 20/31] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:11:45.074968 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b8521-a642-42ca-a145-33041f05c27b None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:45.187352 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b8521-a642-42ca-a145-33041f05c27b None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:45.187998 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 12/32] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Jul 27 16:11:44 2022] POST /identity/v3/roles => generated 219 bytes in 560 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:11:45.188859 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8065aef-ae86-42a3-af40-f21efd983530 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:45.227335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:45.249167 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f757ff1-4e5b-4e30-b95e-1498c372499f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:45.249846 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f757ff1-4e5b-4e30-b95e-1498c372499f None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:45.250135 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f757ff1-4e5b-4e30-b95e-1498c372499f None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:45.250416 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f757ff1-4e5b-4e30-b95e-1498c372499f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:45.278453 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:45.278953 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f757ff1-4e5b-4e30-b95e-1498c372499f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:45.281033 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f757ff1-4e5b-4e30-b95e-1498c372499f None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:45.309919 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-6f757ff1-4e5b-4e30-b95e-1498c372499f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:11:45.309919 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:11:45.309919 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:11:45.309919 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:11:45.309919 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:11:45.309919 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:11:45.309919 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:11:45.309919 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:11:45.309919 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:11:45.309919 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:11:45.309919 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:11:45.309919 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:11:45.309919 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:11:45.309919 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:11:45.309919 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:11:45.310770 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:11:45.310770 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:11:45.310770 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:11:45.310770 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:11:45.310770 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:11:45.310770 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:11:45.310770 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:11:45.310770 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:11:45.310770 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:11:45.310770 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:11:45.310770 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:11:45.310770 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:11:45.310770 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:11:45.310770 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:11:45.310770 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:11:45.310770 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:11:45.310770 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:11:45.311650 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:11:45.311650 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:11:45.311650 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:11:45.311650 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:11:45.313641 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 21/33] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:11:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:11:45.314675 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f757ff1-4e5b-4e30-b95e-1498c372499f None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:45.441417 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f757ff1-4e5b-4e30-b95e-1498c372499f None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:45.445313 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8065aef-ae86-42a3-af40-f21efd983530 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:45.481392 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7c1f7-1985-4d7b-b6d6-460ffd5406e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:45.482429 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7c1f7-1985-4d7b-b6d6-460ffd5406e7 None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:45.482913 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7c1f7-1985-4d7b-b6d6-460ffd5406e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:45.484150 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7c1f7-1985-4d7b-b6d6-460ffd5406e7 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:45.485124 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7c1f7-1985-4d7b-b6d6-460ffd5406e7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:45.486792 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7c1f7-1985-4d7b-b6d6-460ffd5406e7 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:45.489793 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba029ad-4ddd-410c-b0c5-23cdbb012df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:45.490563 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba029ad-4ddd-410c-b0c5-23cdbb012df6 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:45.490856 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba029ad-4ddd-410c-b0c5-23cdbb012df6 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:45.491141 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba029ad-4ddd-410c-b0c5-23cdbb012df6 None admin] PATH_INFO: `/v3/users/30d80e0d318d4f78a4aac8c796957981` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:45.493172 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba029ad-4ddd-410c-b0c5-23cdbb012df6 None admin] RBAC: Authorizing `identity:get_user(user_id=30d80e0d318d4f78a4aac8c796957981)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:45.494794 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba029ad-4ddd-410c-b0c5-23cdbb012df6 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:45.496995 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 13/34] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:11:45 2022] GET /identity/v3/users/30d80e0d318d4f78a4aac8c796957981 => generated 247 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:11:45.497635 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba029ad-4ddd-410c-b0c5-23cdbb012df6 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:45.620256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba029ad-4ddd-410c-b0c5-23cdbb012df6 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:45.623034 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:45.628757 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 22/35] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Jul 27 16:11:45 2022] POST /identity/v3/roles => generated 225 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:11:45.629789 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7c1f7-1985-4d7b-b6d6-460ffd5406e7 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:45.682254 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb777c21-f2c4-4c44-a9fc-1131db7b5f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:45.682898 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb777c21-f2c4-4c44-a9fc-1131db7b5f05 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:45.683185 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb777c21-f2c4-4c44-a9fc-1131db7b5f05 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:45.683578 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb777c21-f2c4-4c44-a9fc-1131db7b5f05 None admin] PATH_INFO: `/v3/domains` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:45.684224 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb777c21-f2c4-4c44-a9fc-1131db7b5f05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:11:45.684534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb777c21-f2c4-4c44-a9fc-1131db7b5f05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:45.685979 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb777c21-f2c4-4c44-a9fc-1131db7b5f05 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:45.694504 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:45.701075 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 14/36] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:11:45.703177 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8c832-795c-43a7-ba00-3e7320746d1e None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:45.707649 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8c832-795c-43a7-ba00-3e7320746d1e None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:45.707649 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8c832-795c-43a7-ba00-3e7320746d1e None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:45.707649 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 15/37] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:11:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:11:45.707649 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a9399-29d6-41ff-ae05-b9a06b3c3d3e None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:45.707649 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a9399-29d6-41ff-ae05-b9a06b3c3d3e None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:45.707649 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a9399-29d6-41ff-ae05-b9a06b3c3d3e None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:45.708100 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 16/38] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:11:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:11:45.708569 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a9399-29d6-41ff-ae05-b9a06b3c3d3e None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:45.778186 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7c1f7-1985-4d7b-b6d6-460ffd5406e7 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:45.819614 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20bc3bb-8cdd-4ae5-a17b-0d6f045b0e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:45.820399 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bc3bb-8cdd-4ae5-a17b-0d6f045b0e9f None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:45.820686 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bc3bb-8cdd-4ae5-a17b-0d6f045b0e9f None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:45.820967 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bc3bb-8cdd-4ae5-a17b-0d6f045b0e9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:45.822218 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20bc3bb-8cdd-4ae5-a17b-0d6f045b0e9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:45.823890 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20bc3bb-8cdd-4ae5-a17b-0d6f045b0e9f None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:45.828367 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 23/39] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:11:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:11:45.828367 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3c96e-1033-4209-a50f-32767fb28a8d None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:45.828367 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3c96e-1033-4209-a50f-32767fb28a8d None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:45.828367 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3c96e-1033-4209-a50f-32767fb28a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:45.840246 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a9399-29d6-41ff-ae05-b9a06b3c3d3e None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:45.846524 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-f5e3c96e-1033-4209-a50f-32767fb28a8d None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:11:45.848086 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-f5e3c96e-1033-4209-a50f-32767fb28a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:11:45.880702 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288eb29e-8c23-48ab-8a75-aa079458d4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:45.881339 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288eb29e-8c23-48ab-8a75-aa079458d4b9 None admin] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:45.881622 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288eb29e-8c23-48ab-8a75-aa079458d4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:45.881945 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288eb29e-8c23-48ab-8a75-aa079458d4b9 None admin] PATH_INFO: `/v3/projects` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:45.882581 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288eb29e-8c23-48ab-8a75-aa079458d4b9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:45.884056 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288eb29e-8c23-48ab-8a75-aa079458d4b9 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:45.918108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 17/40] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 16:11:45 2022] POST /identity/v3/projects => generated 301 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:11:45.919495 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b4dac-f154-4f60-8fb5-0a903493855e None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:45.919796 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b4dac-f154-4f60-8fb5-0a903493855e None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:45.920081 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b4dac-f154-4f60-8fb5-0a903493855e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:45.920802 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 24/41] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:11:45.921644 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3c96e-1033-4209-a50f-32767fb28a8d None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:45.944256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-134b4dac-f154-4f60-8fb5-0a903493855e None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:11:45.946105 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-134b4dac-f154-4f60-8fb5-0a903493855e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:11:45.959751 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:45.975199 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:46.029190 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 18/42] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:11:46.030360 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b4dac-f154-4f60-8fb5-0a903493855e None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:46.064817 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3c96e-1033-4209-a50f-32767fb28a8d None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:46.103192 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5824c56-c71d-404f-b319-691ed8e0b6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:46.103953 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5824c56-c71d-404f-b319-691ed8e0b6f8 None admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:46.104245 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5824c56-c71d-404f-b319-691ed8e0b6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:46.104537 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5824c56-c71d-404f-b319-691ed8e0b6f8 None admin] PATH_INFO: `/v3/domains/default/users/30d80e0d318d4f78a4aac8c796957981/roles/76e01abae9964dd5b28fc8895f739ee4` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:46.106756 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5824c56-c71d-404f-b319-691ed8e0b6f8 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=30d80e0d318d4f78a4aac8c796957981, role_id=76e01abae9964dd5b28fc8895f739ee4)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:46.109223 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5824c56-c71d-404f-b319-691ed8e0b6f8 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:46.125173 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 25/43] 10.222.0.65 () {58 vars in 1361 bytes} [Wed Jul 27 16:11:45 2022] PUT /identity/v3/domains/default/users/30d80e0d318d4f78a4aac8c796957981/roles/76e01abae9964dd5b28fc8895f739ee4 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:11:46.126013 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5824c56-c71d-404f-b319-691ed8e0b6f8 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:46.169579 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b4dac-f154-4f60-8fb5-0a903493855e None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:46.223042 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6955367-016b-4507-afd3-af52ba0493cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:46.223693 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6955367-016b-4507-afd3-af52ba0493cf None admin] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:46.223943 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6955367-016b-4507-afd3-af52ba0493cf None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:46.224218 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6955367-016b-4507-afd3-af52ba0493cf None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:46.225015 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6955367-016b-4507-afd3-af52ba0493cf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:46.226898 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6955367-016b-4507-afd3-af52ba0493cf None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:46.245664 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 19/44] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Jul 27 16:11:46 2022] POST /identity/v3/roles => generated 223 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:11:46.255077 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:46.263850 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5824c56-c71d-404f-b319-691ed8e0b6f8 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:46.308774 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b65336-05e2-4449-afef-7ed23de78f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:46.309475 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b65336-05e2-4449-afef-7ed23de78f4b None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:46.309766 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b65336-05e2-4449-afef-7ed23de78f4b None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:46.310054 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b65336-05e2-4449-afef-7ed23de78f4b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:46.311430 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b65336-05e2-4449-afef-7ed23de78f4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:46.314068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b65336-05e2-4449-afef-7ed23de78f4b None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:46.315460 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 26/45] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:11:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:11:46.321310 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6955367-016b-4507-afd3-af52ba0493cf None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:46.330833 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:46.442852 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6955367-016b-4507-afd3-af52ba0493cf None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:46.479112 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5929c-7b47-4a8e-ba40-4c47dd863479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:46.479688 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5929c-7b47-4a8e-ba40-4c47dd863479 None admin] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:46.479980 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5929c-7b47-4a8e-ba40-4c47dd863479 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:46.480268 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5929c-7b47-4a8e-ba40-4c47dd863479 None admin] PATH_INFO: `/v3/projects` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:46.480964 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff5929c-7b47-4a8e-ba40-4c47dd863479 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:46.482447 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff5929c-7b47-4a8e-ba40-4c47dd863479 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:46.509436 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 20/46] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 16:11:46 2022] POST /identity/v3/projects => generated 312 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:11:48.350972 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f3468-8df3-4b7f-964e-5739e30fa5da None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:48.351506 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f3468-8df3-4b7f-964e-5739e30fa5da None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:48.351612 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f3468-8df3-4b7f-964e-5739e30fa5da None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:48.352933 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 27/47] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:11:48.358333 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5c79f-a8b0-4973-b0be-352f6178d267 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:48.359218 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5c79f-a8b0-4973-b0be-352f6178d267 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:48.359583 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5c79f-a8b0-4973-b0be-352f6178d267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:48.377654 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-72c5c79f-a8b0-4973-b0be-352f6178d267 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:11:48.378841 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-72c5c79f-a8b0-4973-b0be-352f6178d267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:11:48.431603 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:48.445366 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 21/48] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:11:48.469837 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f3468-8df3-4b7f-964e-5739e30fa5da None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:48.578442 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f3468-8df3-4b7f-964e-5739e30fa5da None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:48.614702 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0aa040-1123-4b34-8d5f-3960f6f36591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:48.615274 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0aa040-1123-4b34-8d5f-3960f6f36591 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:48.615601 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0aa040-1123-4b34-8d5f-3960f6f36591 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:48.615887 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0aa040-1123-4b34-8d5f-3960f6f36591 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:48.626658 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0aa040-1123-4b34-8d5f-3960f6f36591 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:11:48.632153 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-8f0aa040-1123-4b34-8d5f-3960f6f36591 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:11:48.632153 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:11:48.632153 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:11:48.632153 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:11:48.632153 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:11:48.632153 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:11:48.632153 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:11:48.632153 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:11:48.632153 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:11:48.632153 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:11:48.632153 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:11:48.632153 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:11:48.632153 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:11:48.632153 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:11:48.632153 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:11:48.632153 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:11:48.632956 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:11:48.632956 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:11:48.632956 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:11:48.632956 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:11:48.632956 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:11:48.632956 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:11:48.632956 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:11:48.632956 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:11:48.632956 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:11:48.632956 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:11:48.632956 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:11:48.632956 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:11:48.632956 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:11:48.632956 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:11:48.632956 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:11:48.632956 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:11:48.633962 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:11:48.633962 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:11:48.633962 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:11:48.633962 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:11:48.633962 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:11:48.633962 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:11:48.633962 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:11:48.633962 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:11:48.633962 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:11:48.633962 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:11:48.633962 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:11:48.633962 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:11:48.633962 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 28/49] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 16:11:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:11:48.639223 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5c79f-a8b0-4973-b0be-352f6178d267 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:48.728749 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea5b09-27fe-48ed-9c83-3d8ea20f1e86 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:48.729039 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea5b09-27fe-48ed-9c83-3d8ea20f1e86 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:48.729327 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea5b09-27fe-48ed-9c83-3d8ea20f1e86 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:48.730703 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 29/50] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:11:48.736174 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4466a82-5064-4d77-9130-a7103541cd43 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:48.736465 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4466a82-5064-4d77-9130-a7103541cd43 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:48.736751 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4466a82-5064-4d77-9130-a7103541cd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:48.746210 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5c79f-a8b0-4973-b0be-352f6178d267 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:48.754830 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-a4466a82-5064-4d77-9130-a7103541cd43 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:11:48.756063 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-a4466a82-5064-4d77-9130-a7103541cd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:11:48.773262 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:48.781096 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410df91-ce1c-4fa2-a5bc-9197bb7f9d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:48.781726 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410df91-ce1c-4fa2-a5bc-9197bb7f9d44 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:48.782014 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410df91-ce1c-4fa2-a5bc-9197bb7f9d44 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:48.782298 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410df91-ce1c-4fa2-a5bc-9197bb7f9d44 None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:48.783024 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1410df91-ce1c-4fa2-a5bc-9197bb7f9d44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:11:48.783344 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1410df91-ce1c-4fa2-a5bc-9197bb7f9d44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:48.784774 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1410df91-ce1c-4fa2-a5bc-9197bb7f9d44 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:48.802976 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 22/51] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:11:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:11:48.804209 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410df91-ce1c-4fa2-a5bc-9197bb7f9d44 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:48.824284 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 30/52] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:11:48.848309 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4466a82-5064-4d77-9130-a7103541cd43 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:48.852979 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:48.903867 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410df91-ce1c-4fa2-a5bc-9197bb7f9d44 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:48.940156 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af5c94-a801-44ba-a2cb-172ba71c9d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:48.940816 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af5c94-a801-44ba-a2cb-172ba71c9d75 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:48.941106 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af5c94-a801-44ba-a2cb-172ba71c9d75 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:48.941382 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af5c94-a801-44ba-a2cb-172ba71c9d75 None admin] PATH_INFO: `/v3/users/30d80e0d318d4f78a4aac8c796957981` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:48.942565 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af5c94-a801-44ba-a2cb-172ba71c9d75 None admin] RBAC: Authorizing `identity:get_user(user_id=30d80e0d318d4f78a4aac8c796957981)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:48.944048 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af5c94-a801-44ba-a2cb-172ba71c9d75 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:48.945646 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 23/53] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:11:48 2022] GET /identity/v3/users/30d80e0d318d4f78a4aac8c796957981 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:11:48.947188 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4466a82-5064-4d77-9130-a7103541cd43 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:48.951081 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af5c94-a801-44ba-a2cb-172ba71c9d75 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:48.981281 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0361929-6f8d-4332-bffb-0e96d9ba74ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:48.981926 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0361929-6f8d-4332-bffb-0e96d9ba74ef None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:48.982216 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0361929-6f8d-4332-bffb-0e96d9ba74ef None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:48.982495 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0361929-6f8d-4332-bffb-0e96d9ba74ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:48.984219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0361929-6f8d-4332-bffb-0e96d9ba74ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:48.985698 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0361929-6f8d-4332-bffb-0e96d9ba74ef None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:48.987285 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 31/54] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:11:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:11:48.992987 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0361929-6f8d-4332-bffb-0e96d9ba74ef None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:49.017072 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:49.049869 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af5c94-a801-44ba-a2cb-172ba71c9d75 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:49.068037 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:49.086439 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe69f1f-3e1e-493b-abe1-b17f763d4dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:49.087099 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe69f1f-3e1e-493b-abe1-b17f763d4dde None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:49.087392 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe69f1f-3e1e-493b-abe1-b17f763d4dde None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:49.087689 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe69f1f-3e1e-493b-abe1-b17f763d4dde None admin] PATH_INFO: `/v3/domains/default` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:49.088853 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe69f1f-3e1e-493b-abe1-b17f763d4dde None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:49.090293 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe69f1f-3e1e-493b-abe1-b17f763d4dde None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:49.092124 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 24/55] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:11:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:11:49.093917 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0361929-6f8d-4332-bffb-0e96d9ba74ef None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:49.097670 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe69f1f-3e1e-493b-abe1-b17f763d4dde None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:49.130386 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80903230-7572-4e8f-a920-ea6b5b83a45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:49.131031 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80903230-7572-4e8f-a920-ea6b5b83a45f None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:49.131313 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80903230-7572-4e8f-a920-ea6b5b83a45f None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:49.131625 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80903230-7572-4e8f-a920-ea6b5b83a45f None admin] PATH_INFO: `/v3/projects` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:49.132324 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80903230-7572-4e8f-a920-ea6b5b83a45f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:49.133796 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80903230-7572-4e8f-a920-ea6b5b83a45f None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:49.162536 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 32/56] 10.222.0.65 () {60 vars in 1140 bytes} [Wed Jul 27 16:11:48 2022] POST /identity/v3/projects => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:11:49.203795 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe69f1f-3e1e-493b-abe1-b17f763d4dde None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:49.240970 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf330ab1-206f-4ad7-ba8d-595b266d8b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:49.241617 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf330ab1-206f-4ad7-ba8d-595b266d8b92 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:49.241910 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf330ab1-206f-4ad7-ba8d-595b266d8b92 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:49.242193 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf330ab1-206f-4ad7-ba8d-595b266d8b92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:49.243009 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf330ab1-206f-4ad7-ba8d-595b266d8b92 None admin] RBAC: Adding query filter params (role.id=76e01abae9964dd5b28fc8895f739ee4, scope.domain.id=default, user.id=30d80e0d318d4f78a4aac8c796957981) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:11:49.243322 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf330ab1-206f-4ad7-ba8d-595b266d8b92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:49.244841 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf330ab1-206f-4ad7-ba8d-595b266d8b92 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:49.255216 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 25/57] 10.222.0.65 () {56 vars in 1322 bytes} [Wed Jul 27 16:11:49 2022] GET /identity/v3/role_assignments?user.id=30d80e0d318d4f78a4aac8c796957981&scope.domain.id=default&role.id=76e01abae9964dd5b28fc8895f739ee4 => generated 530 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:11:51.398833 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761d7b0-192e-498b-ab4f-bed0cd831736 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:51.399444 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761d7b0-192e-498b-ab4f-bed0cd831736 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:51.399610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761d7b0-192e-498b-ab4f-bed0cd831736 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:51.402010 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 33/58] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:11:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:11:51.407523 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2adc9-640d-496d-8978-f808bdf75110 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:51.408008 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2adc9-640d-496d-8978-f808bdf75110 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:51.408150 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2adc9-640d-496d-8978-f808bdf75110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:51.427114 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-87a2adc9-640d-496d-8978-f808bdf75110 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:11:51.428339 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-87a2adc9-640d-496d-8978-f808bdf75110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:11:51.474579 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:51.496436 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 26/59] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:11:51.522221 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761d7b0-192e-498b-ab4f-bed0cd831736 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:51.599783 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:51.627523 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761d7b0-192e-498b-ab4f-bed0cd831736 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:51.661326 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a635731-2e5f-474b-af98-0dc4dcf5017c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:51.661904 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a635731-2e5f-474b-af98-0dc4dcf5017c None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:51.662195 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a635731-2e5f-474b-af98-0dc4dcf5017c None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:51.662472 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a635731-2e5f-474b-af98-0dc4dcf5017c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:51.663669 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a635731-2e5f-474b-af98-0dc4dcf5017c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:51.665143 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a635731-2e5f-474b-af98-0dc4dcf5017c None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:51.666755 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 34/60] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:11:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:11:51.672873 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2adc9-640d-496d-8978-f808bdf75110 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:51.772770 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2adc9-640d-496d-8978-f808bdf75110 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:51.806442 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1147294-7459-432c-a97f-00a9aa4a4c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:51.807069 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1147294-7459-432c-a97f-00a9aa4a4c9a None admin] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:51.807359 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1147294-7459-432c-a97f-00a9aa4a4c9a None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:51.807676 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1147294-7459-432c-a97f-00a9aa4a4c9a None admin] PATH_INFO: `/v3/users` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:51.808415 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1147294-7459-432c-a97f-00a9aa4a4c9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:51.810043 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1147294-7459-432c-a97f-00a9aa4a4c9a None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:51.835673 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 27/61] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 16:11:51 2022] POST /identity/v3/users => generated 275 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:11:55.260332 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaa2bf-b4f6-445d-95cc-71286fc86dd8 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:55.260837 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaa2bf-b4f6-445d-95cc-71286fc86dd8 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:55.260909 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaa2bf-b4f6-445d-95cc-71286fc86dd8 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:55.262253 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 35/62] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:11:55.267725 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e58b94-b355-4892-bb79-b62e363f24a1 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:55.268538 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e58b94-b355-4892-bb79-b62e363f24a1 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:55.269006 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e58b94-b355-4892-bb79-b62e363f24a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:55.297207 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-47e58b94-b355-4892-bb79-b62e363f24a1 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:11:55.298758 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-47e58b94-b355-4892-bb79-b62e363f24a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:11:55.336131 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388320f-81be-4663-8dd8-c0ec08ca6393 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:55.336875 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388320f-81be-4663-8dd8-c0ec08ca6393 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:55.337370 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388320f-81be-4663-8dd8-c0ec08ca6393 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:55.337495 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:55.339091 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 36/63] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:11:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:11:55.345130 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fa085-c65c-4779-9f77-fb593f778199 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:55.345694 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fa085-c65c-4779-9f77-fb593f778199 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:55.346180 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fa085-c65c-4779-9f77-fb593f778199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:55.379874 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-0f6fa085-c65c-4779-9f77-fb593f778199 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:11:55.381093 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-0f6fa085-c65c-4779-9f77-fb593f778199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:11:55.402420 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 28/64] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:11:55.447039 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e58b94-b355-4892-bb79-b62e363f24a1 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:55.509722 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 37/65] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:11:55.558136 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fa085-c65c-4779-9f77-fb593f778199 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:55.578430 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e58b94-b355-4892-bb79-b62e363f24a1 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:55.617211 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99cb80-9c84-4bbe-9f7f-066553f39191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:55.618100 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99cb80-9c84-4bbe-9f7f-066553f39191 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:55.618523 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99cb80-9c84-4bbe-9f7f-066553f39191 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:55.618937 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99cb80-9c84-4bbe-9f7f-066553f39191 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:55.630261 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99cb80-9c84-4bbe-9f7f-066553f39191 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:11:55.635670 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-1a99cb80-9c84-4bbe-9f7f-066553f39191 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:11:55.635670 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:11:55.635670 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:11:55.635670 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:11:55.635670 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:11:55.635670 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:11:55.635670 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:11:55.635670 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:11:55.635670 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:11:55.635670 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:11:55.635670 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:11:55.635670 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:11:55.635670 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:11:55.635670 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:11:55.635670 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:11:55.635670 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:11:55.636486 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:11:55.636486 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:11:55.636486 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:11:55.636486 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:11:55.636486 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:11:55.636486 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:11:55.636486 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:11:55.636486 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:11:55.636486 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:11:55.636486 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:11:55.636486 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:11:55.636486 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:11:55.636486 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:11:55.636486 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:11:55.636486 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:11:55.636486 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:11:55.637216 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:11:55.637216 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:11:55.637216 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:11:55.637216 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:11:55.637216 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:11:55.637216 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:11:55.637216 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:11:55.637216 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:11:55.637216 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:11:55.637216 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:11:55.637216 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:11:55.637216 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:11:55.639333 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 29/66] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:11:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:11:55.645898 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99cb80-9c84-4bbe-9f7f-066553f39191 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:55.681525 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:55.721426 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:55.754650 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fa085-c65c-4779-9f77-fb593f778199 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:55.767880 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99cb80-9c84-4bbe-9f7f-066553f39191 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:55.794654 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeaf546-8802-4569-bcd9-a6a583f0b6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:55.795819 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeaf546-8802-4569-bcd9-a6a583f0b6aa None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:55.797004 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeaf546-8802-4569-bcd9-a6a583f0b6aa None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:55.797484 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeaf546-8802-4569-bcd9-a6a583f0b6aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:55.808587 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1788c-f429-498e-863a-cb7817e97959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:55.809147 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1788c-f429-498e-863a-cb7817e97959 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:55.809431 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1788c-f429-498e-863a-cb7817e97959 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:55.809671 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeaf546-8802-4569-bcd9-a6a583f0b6aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:11:55.809769 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1788c-f429-498e-863a-cb7817e97959 None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:55.810506 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd1788c-f429-498e-863a-cb7817e97959 None admin] RBAC: Adding query filter params (name=member) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:11:55.810815 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd1788c-f429-498e-863a-cb7817e97959 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:55.812280 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd1788c-f429-498e-863a-cb7817e97959 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:55.816260 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-4eeaf546-8802-4569-bcd9-a6a583f0b6aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:11:55.816260 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:11:55.816260 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:11:55.816260 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:11:55.816260 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:11:55.816260 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:11:55.816260 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:11:55.816260 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:11:55.816260 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:11:55.816260 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:11:55.816260 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:11:55.816260 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:11:55.816260 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:11:55.816260 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:11:55.816260 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:11:55.816260 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:11:55.817943 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:11:55.817943 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:11:55.817943 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:11:55.817943 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:11:55.817943 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:11:55.817943 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:11:55.817943 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:11:55.817943 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:11:55.817943 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:11:55.817943 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:11:55.817943 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:11:55.817943 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:11:55.817943 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:11:55.817943 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:11:55.817943 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:11:55.817943 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:11:55.818918 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:11:55.818918 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:11:55.818918 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:11:55.818918 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:11:55.818918 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:11:55.818918 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:11:55.818918 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:11:55.818918 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:11:55.818918 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:11:55.818918 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:11:55.818918 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:11:55.818918 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:11:55.821448 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 38/67] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 16:11:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:11:55.822122 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 30/68] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 16:11:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:11:55.823871 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b73703-d5cd-44f5-a581-263860a4314b None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:55.825025 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b73703-d5cd-44f5-a581-263860a4314b None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:55.825652 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b73703-d5cd-44f5-a581-263860a4314b None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:55.826318 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1ae45-a618-452d-9574-8c425e769656 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:55.826619 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1ae45-a618-452d-9574-8c425e769656 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:55.827177 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1ae45-a618-452d-9574-8c425e769656 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:55.827910 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 39/69] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:11:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:11:55.828453 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b73703-d5cd-44f5-a581-263860a4314b None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:55.828621 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 31/70] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:11:55.829320 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1ae45-a618-452d-9574-8c425e769656 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:55.928833 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:55.942820 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1ae45-a618-452d-9574-8c425e769656 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:55.950906 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b73703-d5cd-44f5-a581-263860a4314b None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:55.977086 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa19d2-2f2a-4b33-99dc-2b81e919eca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:55.977718 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa19d2-2f2a-4b33-99dc-2b81e919eca1 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:55.978008 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa19d2-2f2a-4b33-99dc-2b81e919eca1 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:55.978288 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa19d2-2f2a-4b33-99dc-2b81e919eca1 None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:55.979006 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa19d2-2f2a-4b33-99dc-2b81e919eca1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:11:55.979320 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa19d2-2f2a-4b33-99dc-2b81e919eca1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:55.980759 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa19d2-2f2a-4b33-99dc-2b81e919eca1 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:55.980872 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:55.986154 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386de3db-13f3-4406-860b-0555be8d0cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:55.986985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386de3db-13f3-4406-860b-0555be8d0cc4 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:55.987348 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386de3db-13f3-4406-860b-0555be8d0cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:55.987589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386de3db-13f3-4406-860b-0555be8d0cc4 None admin] PATH_INFO: `/v3/users/b4367dec09b843eeafd691b9d6214a78` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:55.989610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 32/71] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:11:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:11:55.990998 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdaaf0-8bec-47ad-a1bd-ebde7f1d5cac None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:55.991295 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdaaf0-8bec-47ad-a1bd-ebde7f1d5cac None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:55.991691 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdaaf0-8bec-47ad-a1bd-ebde7f1d5cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:56.001860 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386de3db-13f3-4406-860b-0555be8d0cc4 None admin] RBAC: Authorizing `identity:get_user(user_id=b4367dec09b843eeafd691b9d6214a78)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:56.003342 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386de3db-13f3-4406-860b-0555be8d0cc4 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:56.005047 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 40/72] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:11:55 2022] GET /identity/v3/users/b4367dec09b843eeafd691b9d6214a78 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:11:56.006225 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9858f-459b-44b1-8752-04e5fecfd905 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:56.006512 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9858f-459b-44b1-8752-04e5fecfd905 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:56.006789 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9858f-459b-44b1-8752-04e5fecfd905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:56.009615 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-e2cdaaf0-8bec-47ad-a1bd-ebde7f1d5cac None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:11:56.010921 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-e2cdaaf0-8bec-47ad-a1bd-ebde7f1d5cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:11:56.024577 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-ebb9858f-459b-44b1-8752-04e5fecfd905 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:11:56.025756 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-ebb9858f-459b-44b1-8752-04e5fecfd905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:11:56.079407 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 33/73] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:11:56.080610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547e442-ab7d-4016-b4ee-be07adccf37f None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:56.080902 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547e442-ab7d-4016-b4ee-be07adccf37f None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:56.081424 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547e442-ab7d-4016-b4ee-be07adccf37f None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:56.082438 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 34/74] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:11:56.083156 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547e442-ab7d-4016-b4ee-be07adccf37f None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:56.097379 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 41/75] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:11:56.100295 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9858f-459b-44b1-8752-04e5fecfd905 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:56.196137 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:56.206386 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9858f-459b-44b1-8752-04e5fecfd905 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:56.216386 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547e442-ab7d-4016-b4ee-be07adccf37f None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:56.226622 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:56.241253 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8223b-294d-4c81-b756-be6069c0054d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:56.241898 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8223b-294d-4c81-b756-be6069c0054d None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:56.242189 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8223b-294d-4c81-b756-be6069c0054d None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:56.242473 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8223b-294d-4c81-b756-be6069c0054d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:56.251006 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9518fe-3bb9-4499-abbf-c6041fe0e5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:56.251676 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9518fe-3bb9-4499-abbf-c6041fe0e5b5 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:56.251959 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9518fe-3bb9-4499-abbf-c6041fe0e5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:56.252232 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9518fe-3bb9-4499-abbf-c6041fe0e5b5 None admin] PATH_INFO: `/v3/users/30d80e0d318d4f78a4aac8c796957981` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:56.253403 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9518fe-3bb9-4499-abbf-c6041fe0e5b5 None admin] RBAC: Authorizing `identity:get_user(user_id=30d80e0d318d4f78a4aac8c796957981)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:56.254850 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9518fe-3bb9-4499-abbf-c6041fe0e5b5 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:56.256478 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 35/76] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:11:56 2022] GET /identity/v3/users/30d80e0d318d4f78a4aac8c796957981 => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:11:56.257594 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bf498-7885-4b76-a557-fcab617dafdf None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:56.257877 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bf498-7885-4b76-a557-fcab617dafdf None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:56.258160 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bf498-7885-4b76-a557-fcab617dafdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:56.276618 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-922bf498-7885-4b76-a557-fcab617dafdf None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:11:56.277909 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-922bf498-7885-4b76-a557-fcab617dafdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:11:56.310887 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8223b-294d-4c81-b756-be6069c0054d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:56.312911 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8223b-294d-4c81-b756-be6069c0054d None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:56.344397 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 36/77] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:11:56.345410 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bf498-7885-4b76-a557-fcab617dafdf None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:56.429470 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 42/78] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:11:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:11:56.429660 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:56.430888 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8223b-294d-4c81-b756-be6069c0054d None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:56.451514 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:56.455547 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bf498-7885-4b76-a557-fcab617dafdf None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:56.493674 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045df17-b326-4290-a8bc-f0f524ce9d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:56.494696 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045df17-b326-4290-a8bc-f0f524ce9d8b None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:56.495175 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045df17-b326-4290-a8bc-f0f524ce9d8b None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:56.495685 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045df17-b326-4290-a8bc-f0f524ce9d8b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:56.510912 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045df17-b326-4290-a8bc-f0f524ce9d8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:11:56.520098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-6045df17-b326-4290-a8bc-f0f524ce9d8b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:11:56.520098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:11:56.520098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:11:56.520098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:11:56.520098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:11:56.520098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:11:56.520098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:11:56.520098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:11:56.520098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:11:56.520098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:11:56.520098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:11:56.520098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:11:56.520098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:11:56.520098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:11:56.520098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:11:56.520098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:11:56.521023 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:11:56.521023 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:11:56.521023 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:11:56.521023 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:11:56.521023 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:11:56.521023 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:11:56.521023 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:11:56.521023 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:11:56.521023 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:11:56.521023 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:11:56.521023 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:11:56.521023 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:11:56.521023 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:11:56.521023 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:11:56.521023 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:11:56.521023 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:11:56.521929 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:11:56.521929 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:11:56.521929 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:11:56.521929 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:11:56.521929 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:11:56.521929 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:11:56.521929 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:11:56.521929 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:11:56.521929 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:11:56.521929 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:11:56.521929 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:11:56.521929 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:11:56.527265 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 37/79] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 16:11:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:11:56.527265 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045df17-b326-4290-a8bc-f0f524ce9d8b None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:56.550923 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8223b-294d-4c81-b756-be6069c0054d None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:56.584285 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740a214-7223-4ccd-8c84-0685fa9bf8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:56.584931 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740a214-7223-4ccd-8c84-0685fa9bf8ad None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:56.585219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740a214-7223-4ccd-8c84-0685fa9bf8ad None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:56.585505 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740a214-7223-4ccd-8c84-0685fa9bf8ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:56.596030 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740a214-7223-4ccd-8c84-0685fa9bf8ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:11:56.600916 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-f740a214-7223-4ccd-8c84-0685fa9bf8ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:11:56.600916 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:11:56.600916 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:11:56.600916 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:11:56.600916 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:11:56.600916 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:11:56.600916 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:11:56.600916 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:11:56.600916 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:11:56.600916 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:11:56.600916 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:11:56.600916 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:11:56.600916 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:11:56.600916 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:11:56.600916 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:11:56.600916 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:11:56.601963 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:11:56.601963 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:11:56.601963 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:11:56.601963 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:11:56.601963 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:11:56.601963 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:11:56.601963 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:11:56.601963 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:11:56.601963 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:11:56.601963 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:11:56.601963 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:11:56.601963 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:11:56.601963 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:11:56.601963 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:11:56.601963 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:11:56.601963 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:11:56.603068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:11:56.603068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:11:56.603068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:11:56.603068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:11:56.603068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:11:56.603068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:11:56.603068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:11:56.603068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:11:56.603068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:11:56.603068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:11:56.603068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:11:56.603068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:11:56.603068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 43/80] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:11:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:11:56.603068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740a214-7223-4ccd-8c84-0685fa9bf8ad None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:56.629171 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045df17-b326-4290-a8bc-f0f524ce9d8b None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:56.663577 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944e589-662a-480f-b2b9-5ba43cc90880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:56.664204 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944e589-662a-480f-b2b9-5ba43cc90880 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:56.664513 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944e589-662a-480f-b2b9-5ba43cc90880 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:56.664791 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944e589-662a-480f-b2b9-5ba43cc90880 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:56.679356 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:56.684983 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:56.704820 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740a214-7223-4ccd-8c84-0685fa9bf8ad None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:56.738072 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7970ca9-844e-4f77-8be8-55e3ea17df77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:56.738734 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7970ca9-844e-4f77-8be8-55e3ea17df77 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:56.739009 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7970ca9-844e-4f77-8be8-55e3ea17df77 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:56.739290 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7970ca9-844e-4f77-8be8-55e3ea17df77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:56.739912 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944e589-662a-480f-b2b9-5ba43cc90880 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:56.740474 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7970ca9-844e-4f77-8be8-55e3ea17df77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:56.741488 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944e589-662a-480f-b2b9-5ba43cc90880 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:56.741923 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7970ca9-844e-4f77-8be8-55e3ea17df77 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:56.743551 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 44/81] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:11:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:11:56.744361 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7970ca9-844e-4f77-8be8-55e3ea17df77 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:56.840208 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 38/82] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:11:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:11:56.841571 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944e589-662a-480f-b2b9-5ba43cc90880 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:56.849638 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7970ca9-844e-4f77-8be8-55e3ea17df77 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:56.881007 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:56.883240 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429bf6d-c6a3-46dd-9c62-b389626b2e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:56.884006 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429bf6d-c6a3-46dd-9c62-b389626b2e51 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:56.884293 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429bf6d-c6a3-46dd-9c62-b389626b2e51 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:56.884598 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429bf6d-c6a3-46dd-9c62-b389626b2e51 None admin] PATH_INFO: `/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:56.885794 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429bf6d-c6a3-46dd-9c62-b389626b2e51 None admin] RBAC: Authorizing `identity:get_project(project_id=8ac4a2d636fc4ebdb5fd8e84d1834c46)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:56.887247 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429bf6d-c6a3-46dd-9c62-b389626b2e51 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:56.888946 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 45/83] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:11:56 2022] GET /identity/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:11:56.890268 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429bf6d-c6a3-46dd-9c62-b389626b2e51 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:56.908793 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:56.948573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944e589-662a-480f-b2b9-5ba43cc90880 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:56.982992 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b234bdd-b0a2-45d9-8817-4221833d0074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:56.983687 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b234bdd-b0a2-45d9-8817-4221833d0074 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:56.983977 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b234bdd-b0a2-45d9-8817-4221833d0074 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:56.984261 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b234bdd-b0a2-45d9-8817-4221833d0074 None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:56.984982 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b234bdd-b0a2-45d9-8817-4221833d0074 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:11:56.985296 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b234bdd-b0a2-45d9-8817-4221833d0074 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:56.986693 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b234bdd-b0a2-45d9-8817-4221833d0074 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:56.991755 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429bf6d-c6a3-46dd-9c62-b389626b2e51 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:56.994644 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 39/84] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:11:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:11:56.995463 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b234bdd-b0a2-45d9-8817-4221833d0074 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:57.025749 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82ab08-c835-4abf-a645-cc4183368e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:57.026406 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82ab08-c835-4abf-a645-cc4183368e9b None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:57.026696 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82ab08-c835-4abf-a645-cc4183368e9b None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:57.026973 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82ab08-c835-4abf-a645-cc4183368e9b None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:57.027716 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82ab08-c835-4abf-a645-cc4183368e9b None admin] RBAC: Adding query filter params (name=member) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:11:57.028023 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82ab08-c835-4abf-a645-cc4183368e9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:57.029429 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82ab08-c835-4abf-a645-cc4183368e9b None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:57.038432 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 46/85] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 16:11:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:11:57.039422 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82ab08-c835-4abf-a645-cc4183368e9b None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:57.102662 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:57.105774 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b234bdd-b0a2-45d9-8817-4221833d0074 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:57.117777 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:57.140974 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82ab08-c835-4abf-a645-cc4183368e9b None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:57.141874 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4c0f1-7e99-4df9-b220-f40ab52e196c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:57.142506 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4c0f1-7e99-4df9-b220-f40ab52e196c None admin] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:57.142793 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4c0f1-7e99-4df9-b220-f40ab52e196c None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:57.143077 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4c0f1-7e99-4df9-b220-f40ab52e196c None admin] PATH_INFO: `/v3/users` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:57.143926 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db4c0f1-7e99-4df9-b220-f40ab52e196c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:57.145367 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db4c0f1-7e99-4df9-b220-f40ab52e196c None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:57.171197 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 40/86] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 16:11:56 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:11:57.171197 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4c0f1-7e99-4df9-b220-f40ab52e196c None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:57.186292 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b817869-f6ec-4f3a-9a5b-b88d814a319a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:57.187543 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b817869-f6ec-4f3a-9a5b-b88d814a319a None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:57.187834 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b817869-f6ec-4f3a-9a5b-b88d814a319a None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:57.188123 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b817869-f6ec-4f3a-9a5b-b88d814a319a None admin] PATH_INFO: `/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:57.189418 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b817869-f6ec-4f3a-9a5b-b88d814a319a None admin] RBAC: Authorizing `identity:get_project(project_id=8ac4a2d636fc4ebdb5fd8e84d1834c46)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:57.190956 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b817869-f6ec-4f3a-9a5b-b88d814a319a None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:57.192965 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 47/87] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:11:57 2022] GET /identity/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:11:57.193642 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b817869-f6ec-4f3a-9a5b-b88d814a319a None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:57.298077 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4c0f1-7e99-4df9-b220-f40ab52e196c None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:57.323194 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b817869-f6ec-4f3a-9a5b-b88d814a319a None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:57.335880 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a3ce4-3611-4519-99e2-3f3c68423062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:57.336526 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a3ce4-3611-4519-99e2-3f3c68423062 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:57.336819 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a3ce4-3611-4519-99e2-3f3c68423062 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:57.337108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a3ce4-3611-4519-99e2-3f3c68423062 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:57.337920 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a3ce4-3611-4519-99e2-3f3c68423062 None admin] RBAC: Adding query filter params (role.id=5698bc4d332140e9af77ddcbb9915736, scope.project.id=8ac4a2d636fc4ebdb5fd8e84d1834c46, user.id=b4367dec09b843eeafd691b9d6214a78) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:11:57.338240 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a3ce4-3611-4519-99e2-3f3c68423062 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:57.340115 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a3ce4-3611-4519-99e2-3f3c68423062 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:57.347891 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 41/88] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 16:11:57 2022] GET /identity/v3/role_assignments?user.id=b4367dec09b843eeafd691b9d6214a78&scope.project.id=8ac4a2d636fc4ebdb5fd8e84d1834c46&role.id=5698bc4d332140e9af77ddcbb9915736 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:11:57.348727 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a3ce4-3611-4519-99e2-3f3c68423062 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:57.375117 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3cbcf-5632-4730-89e1-0ecc6a1cbb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:57.375680 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3cbcf-5632-4730-89e1-0ecc6a1cbb6f None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:57.376332 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3cbcf-5632-4730-89e1-0ecc6a1cbb6f None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:57.376332 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3cbcf-5632-4730-89e1-0ecc6a1cbb6f None admin] PATH_INFO: `/v3/users/b4367dec09b843eeafd691b9d6214a78` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:57.378269 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b3cbcf-5632-4730-89e1-0ecc6a1cbb6f None admin] RBAC: Authorizing `identity:get_user(user_id=b4367dec09b843eeafd691b9d6214a78)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:57.380001 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b3cbcf-5632-4730-89e1-0ecc6a1cbb6f None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:57.382016 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 48/89] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:11:57 2022] GET /identity/v3/users/b4367dec09b843eeafd691b9d6214a78 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:11:57.382779 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3cbcf-5632-4730-89e1-0ecc6a1cbb6f None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:57.390406 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:57.403139 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:57.511799 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a3ce4-3611-4519-99e2-3f3c68423062 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:57.530403 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3cbcf-5632-4730-89e1-0ecc6a1cbb6f None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:57.581768 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf044c71-3729-4265-834c-cc5aa7775b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:57.582409 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf044c71-3729-4265-834c-cc5aa7775b6f None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:57.582698 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf044c71-3729-4265-834c-cc5aa7775b6f None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:57.583010 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf044c71-3729-4265-834c-cc5aa7775b6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:57.583631 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842071dd-069f-4a6f-8f93-07fb4b28ec8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:57.583828 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf044c71-3729-4265-834c-cc5aa7775b6f None admin] RBAC: Adding query filter params (role.id=76e01abae9964dd5b28fc8895f739ee4, scope.project.id=8ac4a2d636fc4ebdb5fd8e84d1834c46, user.id=30d80e0d318d4f78a4aac8c796957981) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:11:57.584233 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf044c71-3729-4265-834c-cc5aa7775b6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:57.584517 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842071dd-069f-4a6f-8f93-07fb4b28ec8f None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:57.584808 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842071dd-069f-4a6f-8f93-07fb4b28ec8f None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:57.585092 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842071dd-069f-4a6f-8f93-07fb4b28ec8f None admin] PATH_INFO: `/v3/users/b4367dec09b843eeafd691b9d6214a78` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:57.585814 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf044c71-3729-4265-834c-cc5aa7775b6f None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:57.587086 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842071dd-069f-4a6f-8f93-07fb4b28ec8f None admin] RBAC: Authorizing `identity:get_user(user_id=b4367dec09b843eeafd691b9d6214a78)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:57.588575 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842071dd-069f-4a6f-8f93-07fb4b28ec8f None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:57.590235 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 42/90] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:11:57 2022] GET /identity/v3/users/b4367dec09b843eeafd691b9d6214a78 => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:11:57.592307 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 49/91] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 16:11:57 2022] GET /identity/v3/role_assignments?user.id=30d80e0d318d4f78a4aac8c796957981&scope.project.id=8ac4a2d636fc4ebdb5fd8e84d1834c46&role.id=76e01abae9964dd5b28fc8895f739ee4 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:11:57.592554 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842071dd-069f-4a6f-8f93-07fb4b28ec8f None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:57.600811 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf044c71-3729-4265-834c-cc5aa7775b6f None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:57.742982 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:57.775113 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf044c71-3729-4265-834c-cc5aa7775b6f None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:57.775782 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:57.794635 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842071dd-069f-4a6f-8f93-07fb4b28ec8f None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:57.845101 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab070ea-b6df-4721-87ce-e965d018592d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:57.847552 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab070ea-b6df-4721-87ce-e965d018592d None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:57.847890 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab070ea-b6df-4721-87ce-e965d018592d None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:57.848176 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab070ea-b6df-4721-87ce-e965d018592d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:57.857686 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4535a-ce49-4009-ba25-0595eb85e1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:57.858354 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4535a-ce49-4009-ba25-0595eb85e1a9 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:57.859164 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4535a-ce49-4009-ba25-0595eb85e1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:57.859475 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4535a-ce49-4009-ba25-0595eb85e1a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:57.962042 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab070ea-b6df-4721-87ce-e965d018592d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:57.963911 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab070ea-b6df-4721-87ce-e965d018592d None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:57.971678 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4535a-ce49-4009-ba25-0595eb85e1a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:57.973147 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4535a-ce49-4009-ba25-0595eb85e1a9 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:58.142038 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:58.145120 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:58.179404 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 43/92] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:11:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:11:58.184435 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4535a-ce49-4009-ba25-0595eb85e1a9 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:58.194767 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 50/93] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:11:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:11:58.201422 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab070ea-b6df-4721-87ce-e965d018592d None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:58.326334 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4535a-ce49-4009-ba25-0595eb85e1a9 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:58.364136 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6aecbd-8648-40d7-8943-261bf6c0e3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:58.364801 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6aecbd-8648-40d7-8943-261bf6c0e3b6 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:58.365091 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6aecbd-8648-40d7-8943-261bf6c0e3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:58.365377 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6aecbd-8648-40d7-8943-261bf6c0e3b6 None admin] PATH_INFO: `/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:58.366566 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6aecbd-8648-40d7-8943-261bf6c0e3b6 None admin] RBAC: Authorizing `identity:get_project(project_id=8ac4a2d636fc4ebdb5fd8e84d1834c46)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:58.368066 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6aecbd-8648-40d7-8943-261bf6c0e3b6 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:58.369749 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 44/94] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:11:58 2022] GET /identity/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:11:58.376312 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6aecbd-8648-40d7-8943-261bf6c0e3b6 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:58.397503 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab070ea-b6df-4721-87ce-e965d018592d None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:58.446014 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:58.487623 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6aecbd-8648-40d7-8943-261bf6c0e3b6 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:58.527662 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8fd73-752d-458b-aa8c-123d0c1a8ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:58.528502 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8fd73-752d-458b-aa8c-123d0c1a8ac3 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:58.528801 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8fd73-752d-458b-aa8c-123d0c1a8ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:58.529087 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8fd73-752d-458b-aa8c-123d0c1a8ac3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:58.529896 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e8fd73-752d-458b-aa8c-123d0c1a8ac3 None admin] RBAC: Adding query filter params (role.id=cdb6d97b8d4a41e8aaec05181b77fada, scope.project.id=8ac4a2d636fc4ebdb5fd8e84d1834c46, user.id=b4367dec09b843eeafd691b9d6214a78) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:11:58.530736 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e8fd73-752d-458b-aa8c-123d0c1a8ac3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:58.532249 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e8fd73-752d-458b-aa8c-123d0c1a8ac3 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:58.532495 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7bbb37-7b81-47c2-aba3-a62cdeed6ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:58.533581 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7bbb37-7b81-47c2-aba3-a62cdeed6ed5 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:58.534069 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7bbb37-7b81-47c2-aba3-a62cdeed6ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:58.534551 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7bbb37-7b81-47c2-aba3-a62cdeed6ed5 None admin] PATH_INFO: `/v3/projects/644ba54b11da4891b0be9e56d8e96b33` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:58.537145 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7bbb37-7b81-47c2-aba3-a62cdeed6ed5 None admin] RBAC: Authorizing `identity:get_project(project_id=644ba54b11da4891b0be9e56d8e96b33)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:58.538651 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 45/95] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 16:11:58 2022] GET /identity/v3/role_assignments?user.id=b4367dec09b843eeafd691b9d6214a78&scope.project.id=8ac4a2d636fc4ebdb5fd8e84d1834c46&role.id=cdb6d97b8d4a41e8aaec05181b77fada => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:11:58.539263 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7bbb37-7b81-47c2-aba3-a62cdeed6ed5 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:58.541028 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 51/96] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:11:58 2022] GET /identity/v3/projects/644ba54b11da4891b0be9e56d8e96b33 => generated 312 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:11:58.547676 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8fd73-752d-458b-aa8c-123d0c1a8ac3 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:11:58.697194 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8fd73-752d-458b-aa8c-123d0c1a8ac3 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:11:58.727802 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:11:58.743666 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1097f9c-846f-444f-990f-8d611d028ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:11:58.745024 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1097f9c-846f-444f-990f-8d611d028ecc None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:11:58.745316 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1097f9c-846f-444f-990f-8d611d028ecc None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:11:58.745601 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1097f9c-846f-444f-990f-8d611d028ecc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:11:58.746421 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1097f9c-846f-444f-990f-8d611d028ecc None admin] RBAC: Adding query filter params (role.id=5698bc4d332140e9af77ddcbb9915736, scope.project.id=644ba54b11da4891b0be9e56d8e96b33, user.id=b4367dec09b843eeafd691b9d6214a78) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:11:58.746744 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1097f9c-846f-444f-990f-8d611d028ecc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:11:58.748254 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1097f9c-846f-444f-990f-8d611d028ecc None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:11:58.755109 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 46/97] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 16:11:58 2022] GET /identity/v3/role_assignments?user.id=b4367dec09b843eeafd691b9d6214a78&scope.project.id=644ba54b11da4891b0be9e56d8e96b33&role.id=5698bc4d332140e9af77ddcbb9915736 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:00.198886 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab053f8-3e81-448e-b828-59adb43cd483 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:00.199431 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab053f8-3e81-448e-b828-59adb43cd483 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:00.199543 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab053f8-3e81-448e-b828-59adb43cd483 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:00.200990 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 52/98] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:00.207125 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f260e-ecaf-477e-adb2-b1bf961b511c None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:00.207828 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f260e-ecaf-477e-adb2-b1bf961b511c None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:00.207828 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f260e-ecaf-477e-adb2-b1bf961b511c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:00.232375 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-9a7f260e-ecaf-477e-adb2-b1bf961b511c None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:00.233603 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-9a7f260e-ecaf-477e-adb2-b1bf961b511c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:00.318750 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 47/99] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:00.355701 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab053f8-3e81-448e-b828-59adb43cd483 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:00.416531 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:00.493207 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab053f8-3e81-448e-b828-59adb43cd483 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:00.513496 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3705c-0f3c-4624-87dd-5f50d2d1ad20 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:00.513801 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3705c-0f3c-4624-87dd-5f50d2d1ad20 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:00.514062 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3705c-0f3c-4624-87dd-5f50d2d1ad20 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:00.515506 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 48/100] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:12:00.521991 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1664d-b262-4c09-bba7-c1292905a069 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:00.522323 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1664d-b262-4c09-bba7-c1292905a069 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:00.522557 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1664d-b262-4c09-bba7-c1292905a069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:00.545669 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-8be1664d-b262-4c09-bba7-c1292905a069 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:00.547591 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-8be1664d-b262-4c09-bba7-c1292905a069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:00.560590 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde887b-b17e-4636-b0e5-ff2de0a2abda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:00.561552 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde887b-b17e-4636-b0e5-ff2de0a2abda None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:00.563330 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde887b-b17e-4636-b0e5-ff2de0a2abda None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:00.563640 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde887b-b17e-4636-b0e5-ff2de0a2abda None admin] PATH_INFO: `/v3/roles/member` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:00.588362 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde887b-b17e-4636-b0e5-ff2de0a2abda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:00.597698 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-0bde887b-b17e-4636-b0e5-ff2de0a2abda None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:12:00.597698 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:00.597698 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:00.597698 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:00.597698 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:00.597698 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:00.597698 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:00.597698 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:00.597698 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:00.597698 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:00.597698 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:00.597698 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:00.597698 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:00.597698 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:00.597698 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:00.597698 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:00.598686 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:00.598686 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:00.598686 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:00.598686 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:00.598686 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:00.598686 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:00.598686 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:00.598686 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:00.598686 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:00.598686 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:00.598686 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:00.598686 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:00.598686 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:00.598686 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:00.598686 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:00.598686 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:00.600029 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:00.600029 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:00.600029 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:00.600029 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:00.600029 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:00.600029 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:00.600029 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:00.600029 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:00.600029 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:00.600029 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:00.600029 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:12:00.600029 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:00.610235 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 53/101] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:00.612292 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde887b-b17e-4636-b0e5-ff2de0a2abda None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:00.669700 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 49/102] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:12:00.765348 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde887b-b17e-4636-b0e5-ff2de0a2abda None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:00.769817 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1664d-b262-4c09-bba7-c1292905a069 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:00.783748 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:00.844042 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de43f74-6fc6-4cfc-9e2f-42ffd1b6add2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:00.844681 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de43f74-6fc6-4cfc-9e2f-42ffd1b6add2 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:00.844966 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de43f74-6fc6-4cfc-9e2f-42ffd1b6add2 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:00.845244 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de43f74-6fc6-4cfc-9e2f-42ffd1b6add2 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:00.845967 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de43f74-6fc6-4cfc-9e2f-42ffd1b6add2 None admin] RBAC: Adding query filter params (name=member) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:00.846277 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de43f74-6fc6-4cfc-9e2f-42ffd1b6add2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:00.847752 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de43f74-6fc6-4cfc-9e2f-42ffd1b6add2 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:00.855734 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:00.863591 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 54/103] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 16:12:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:00.870030 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de43f74-6fc6-4cfc-9e2f-42ffd1b6add2 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:00.969791 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1664d-b262-4c09-bba7-c1292905a069 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:01.025812 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de43f74-6fc6-4cfc-9e2f-42ffd1b6add2 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:01.034191 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfca926-9ff3-48fd-ae6d-b65a2f7cb301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:01.035266 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfca926-9ff3-48fd-ae6d-b65a2f7cb301 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:01.035930 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfca926-9ff3-48fd-ae6d-b65a2f7cb301 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:01.036687 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfca926-9ff3-48fd-ae6d-b65a2f7cb301 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:01.062741 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796144b-0e45-4877-9fd5-9520dbabe574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:01.063423 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796144b-0e45-4877-9fd5-9520dbabe574 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:01.063716 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796144b-0e45-4877-9fd5-9520dbabe574 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:01.063995 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796144b-0e45-4877-9fd5-9520dbabe574 None admin] PATH_INFO: `/v3/users/b4367dec09b843eeafd691b9d6214a78` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:01.065200 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8796144b-0e45-4877-9fd5-9520dbabe574 None admin] RBAC: Authorizing `identity:get_user(user_id=b4367dec09b843eeafd691b9d6214a78)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:01.066666 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8796144b-0e45-4877-9fd5-9520dbabe574 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:01.068693 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 55/104] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:12:00 2022] GET /identity/v3/users/b4367dec09b843eeafd691b9d6214a78 => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:01.069900 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d9c32-e64b-4425-a7d8-59aa219bbc46 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:01.070190 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d9c32-e64b-4425-a7d8-59aa219bbc46 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:01.070471 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d9c32-e64b-4425-a7d8-59aa219bbc46 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:01.071042 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfca926-9ff3-48fd-ae6d-b65a2f7cb301 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:01.072049 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 56/105] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:01.076637 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-3dfca926-9ff3-48fd-ae6d-b65a2f7cb301 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:12:01.076637 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:01.076637 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:01.076637 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:01.076637 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:01.076637 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:01.076637 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:01.076637 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:01.076637 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:01.076637 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:01.076637 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:01.076637 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:01.076637 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:01.076637 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:01.076637 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:01.076637 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:01.078096 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:01.078096 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:01.078096 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:01.078096 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:01.078096 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:01.078096 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:01.078096 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:01.078096 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:01.078096 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:01.078096 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:01.078096 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:01.078096 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:01.078096 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:01.078096 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:01.078096 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:01.078096 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:01.078860 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:01.078860 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:01.078860 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:01.078860 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:01.078860 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:01.078860 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:01.078860 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:01.078860 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:01.078860 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:01.078860 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:01.078860 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:12:01.078860 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:12:01.083413 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a003dc-fc27-4a1c-8ea0-d918a242bb14 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:01.083413 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a003dc-fc27-4a1c-8ea0-d918a242bb14 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:01.083413 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a003dc-fc27-4a1c-8ea0-d918a242bb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:01.085230 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 50/106] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:12:01.086265 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfca926-9ff3-48fd-ae6d-b65a2f7cb301 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:01.103467 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-22a003dc-fc27-4a1c-8ea0-d918a242bb14 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:01.104781 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-22a003dc-fc27-4a1c-8ea0-d918a242bb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:01.135772 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:01.235045 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 57/107] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:01.236347 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a003dc-fc27-4a1c-8ea0-d918a242bb14 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:01.253331 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfca926-9ff3-48fd-ae6d-b65a2f7cb301 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:01.262385 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:01.316933 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be330d2-fa3e-46ca-bdf4-c59cdfd45ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:01.317594 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be330d2-fa3e-46ca-bdf4-c59cdfd45ae6 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:01.317877 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be330d2-fa3e-46ca-bdf4-c59cdfd45ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:01.318155 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be330d2-fa3e-46ca-bdf4-c59cdfd45ae6 None admin] PATH_INFO: `/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:01.320082 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be330d2-fa3e-46ca-bdf4-c59cdfd45ae6 None admin] RBAC: Authorizing `identity:get_project(project_id=8ac4a2d636fc4ebdb5fd8e84d1834c46)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:01.321605 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be330d2-fa3e-46ca-bdf4-c59cdfd45ae6 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:01.325912 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 51/108] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:01 2022] GET /identity/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:01.327521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be330d2-fa3e-46ca-bdf4-c59cdfd45ae6 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:01.403175 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a003dc-fc27-4a1c-8ea0-d918a242bb14 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:01.442687 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958551b-6801-4274-bb91-d2e74aa88d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:01.443341 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958551b-6801-4274-bb91-d2e74aa88d28 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:01.443695 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958551b-6801-4274-bb91-d2e74aa88d28 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:01.443978 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958551b-6801-4274-bb91-d2e74aa88d28 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:01.444718 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958551b-6801-4274-bb91-d2e74aa88d28 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:01.445032 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958551b-6801-4274-bb91-d2e74aa88d28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:01.446471 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958551b-6801-4274-bb91-d2e74aa88d28 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:01.456141 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 58/109] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 16:12:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:01.457059 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958551b-6801-4274-bb91-d2e74aa88d28 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:01.512594 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:01.581635 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958551b-6801-4274-bb91-d2e74aa88d28 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:01.607196 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be330d2-fa3e-46ca-bdf4-c59cdfd45ae6 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:01.620768 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530c53b-59cd-4d25-9c33-7ce11c88dc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:01.621466 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530c53b-59cd-4d25-9c33-7ce11c88dc64 None admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:01.621879 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530c53b-59cd-4d25-9c33-7ce11c88dc64 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:01.622156 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530c53b-59cd-4d25-9c33-7ce11c88dc64 None admin] PATH_INFO: `/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46/users/b4367dec09b843eeafd691b9d6214a78/roles/5698bc4d332140e9af77ddcbb9915736` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:01.624612 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530c53b-59cd-4d25-9c33-7ce11c88dc64 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ac4a2d636fc4ebdb5fd8e84d1834c46, user_id=b4367dec09b843eeafd691b9d6214a78, role_id=5698bc4d332140e9af77ddcbb9915736)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:01.626309 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530c53b-59cd-4d25-9c33-7ce11c88dc64 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:01.641777 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 59/110] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 16:12:01 2022] PUT /identity/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46/users/b4367dec09b843eeafd691b9d6214a78/roles/5698bc4d332140e9af77ddcbb9915736 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:12:01.643255 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530c53b-59cd-4d25-9c33-7ce11c88dc64 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:01.648559 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430de65-d72d-4dcb-bbfc-0f6afa6d8816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:01.649494 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430de65-d72d-4dcb-bbfc-0f6afa6d8816 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:01.649943 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430de65-d72d-4dcb-bbfc-0f6afa6d8816 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:01.650368 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430de65-d72d-4dcb-bbfc-0f6afa6d8816 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:01.651959 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430de65-d72d-4dcb-bbfc-0f6afa6d8816 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:01.653638 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430de65-d72d-4dcb-bbfc-0f6afa6d8816 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:01.656054 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 52/111] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:12:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:01.657566 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0093fe-7118-4708-8225-c2ef78ca9bfa None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:01.658089 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0093fe-7118-4708-8225-c2ef78ca9bfa None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:01.658573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0093fe-7118-4708-8225-c2ef78ca9bfa None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:01.660041 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 53/112] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:01.661876 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0093fe-7118-4708-8225-c2ef78ca9bfa None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:01.713062 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:01.771459 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:01.781127 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0093fe-7118-4708-8225-c2ef78ca9bfa None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:01.790272 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530c53b-59cd-4d25-9c33-7ce11c88dc64 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:01.820541 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95faf997-605b-4d83-aebc-2f6d5328cb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:01.821587 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95faf997-605b-4d83-aebc-2f6d5328cb5e None admin] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:01.822091 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95faf997-605b-4d83-aebc-2f6d5328cb5e None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:01.822570 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95faf997-605b-4d83-aebc-2f6d5328cb5e None admin] PATH_INFO: `/v3/projects` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:01.823499 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95faf997-605b-4d83-aebc-2f6d5328cb5e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:01.825343 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95faf997-605b-4d83-aebc-2f6d5328cb5e None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:01.828428 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee2a1e-3d30-4d4f-b2e3-5b686c6a81ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:01.829203 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee2a1e-3d30-4d4f-b2e3-5b686c6a81ee None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:01.829491 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee2a1e-3d30-4d4f-b2e3-5b686c6a81ee None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:01.829769 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee2a1e-3d30-4d4f-b2e3-5b686c6a81ee None admin] PATH_INFO: `/v3/users/6944cc55ded644e7af8e7a198f3ba7dd` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:01.849061 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee2a1e-3d30-4d4f-b2e3-5b686c6a81ee None admin] RBAC: Authorizing `identity:get_user(user_id=6944cc55ded644e7af8e7a198f3ba7dd)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:01.850575 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee2a1e-3d30-4d4f-b2e3-5b686c6a81ee None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:01.852651 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 60/113] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:12:01 2022] GET /identity/v3/users/6944cc55ded644e7af8e7a198f3ba7dd => generated 289 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:01.854279 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2924c-9a48-4d17-abda-07eda70a62cb None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:01.854590 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2924c-9a48-4d17-abda-07eda70a62cb None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:01.854879 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2924c-9a48-4d17-abda-07eda70a62cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:01.863743 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 54/114] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 16:12:01 2022] POST /identity/v3/projects => generated 302 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:12:01.865780 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273cd13-ea25-47f9-8af3-3600be71f5a9 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:01.866357 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273cd13-ea25-47f9-8af3-3600be71f5a9 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:01.866961 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273cd13-ea25-47f9-8af3-3600be71f5a9 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:01.869141 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 55/115] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:01.870367 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273cd13-ea25-47f9-8af3-3600be71f5a9 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:01.888649 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-2ac2924c-9a48-4d17-abda-07eda70a62cb None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:01.890440 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-2ac2924c-9a48-4d17-abda-07eda70a62cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:02.019931 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:02.025733 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273cd13-ea25-47f9-8af3-3600be71f5a9 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:02.048765 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 61/116] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:02.050189 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1f5a2-254d-4497-8996-799b58d21325 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:02.050480 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1f5a2-254d-4497-8996-799b58d21325 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:02.050762 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1f5a2-254d-4497-8996-799b58d21325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:02.071004 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52699793-3ba7-427b-b15c-c7581bfef69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:02.072488 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52699793-3ba7-427b-b15c-c7581bfef69c None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:02.076622 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52699793-3ba7-427b-b15c-c7581bfef69c None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:02.077715 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52699793-3ba7-427b-b15c-c7581bfef69c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:02.092420 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-99c1f5a2-254d-4497-8996-799b58d21325 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:02.094172 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-99c1f5a2-254d-4497-8996-799b58d21325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:02.157937 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52699793-3ba7-427b-b15c-c7581bfef69c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:02.159867 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52699793-3ba7-427b-b15c-c7581bfef69c None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:02.178180 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 62/117] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:02.179305 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1f5a2-254d-4497-8996-799b58d21325 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:02.188317 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:02.272611 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:02.283984 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 56/118] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:12:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:12:02.285274 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52699793-3ba7-427b-b15c-c7581bfef69c None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:02.301899 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1f5a2-254d-4497-8996-799b58d21325 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:02.341351 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8b8c6-ab94-4a88-8d5e-d82a9e3312e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:02.342265 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8b8c6-ab94-4a88-8d5e-d82a9e3312e3 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:02.342699 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8b8c6-ab94-4a88-8d5e-d82a9e3312e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:02.343695 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8b8c6-ab94-4a88-8d5e-d82a9e3312e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:02.355233 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8b8c6-ab94-4a88-8d5e-d82a9e3312e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:02.361343 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-e5a8b8c6-ab94-4a88-8d5e-d82a9e3312e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:12:02.361343 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:02.361343 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:02.361343 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:02.361343 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:02.361343 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:02.361343 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:02.361343 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:02.361343 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:02.361343 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:02.361343 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:02.361343 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:02.361343 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:02.361343 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:02.361343 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:02.361343 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:02.362379 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:02.362379 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:02.362379 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:02.362379 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:02.362379 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:02.362379 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:02.362379 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:02.362379 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:02.362379 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:02.362379 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:02.362379 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:02.362379 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:02.362379 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:02.362379 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:02.362379 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:02.362379 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:02.363303 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:02.363303 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:02.363303 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:02.363303 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:02.363303 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:02.363303 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:02.363303 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:02.363303 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:02.363303 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:02.363303 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:02.363303 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:12:02.363303 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:02.369575 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 63/119] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 16:12:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:02.369575 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8b8c6-ab94-4a88-8d5e-d82a9e3312e3 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:02.417559 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52699793-3ba7-427b-b15c-c7581bfef69c None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:02.463898 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbaa9f-7342-44f3-ab28-6bb87f396734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:02.464812 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:02.465655 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbaa9f-7342-44f3-ab28-6bb87f396734 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:02.465952 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbaa9f-7342-44f3-ab28-6bb87f396734 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:02.467143 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbaa9f-7342-44f3-ab28-6bb87f396734 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:02.482991 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbaa9f-7342-44f3-ab28-6bb87f396734 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:02.490285 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-fbdbaa9f-7342-44f3-ab28-6bb87f396734 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:12:02.490285 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:02.490285 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:02.490285 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:02.490285 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:02.490285 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:02.490285 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:02.490285 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:02.490285 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:02.490285 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:02.490285 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:02.490285 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:02.490285 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:02.490285 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:02.490285 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:02.490285 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:02.491334 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:02.491334 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:02.491334 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:02.491334 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:02.491334 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:02.491334 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:02.491334 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:02.491334 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:02.491334 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:02.491334 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:02.491334 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:02.491334 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:02.491334 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:02.491334 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:02.491334 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:02.491334 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:02.492365 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:02.492365 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:02.492365 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:02.492365 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:02.492365 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:02.492365 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:02.492365 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:02.492365 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:02.492365 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:02.492365 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:02.492365 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:12:02.492365 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:12:02.492365 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 57/120] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:02.493162 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbaa9f-7342-44f3-ab28-6bb87f396734 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:02.511797 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8b8c6-ab94-4a88-8d5e-d82a9e3312e3 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:02.556303 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2b133-8c41-4cbf-ba9f-a09154228a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:02.557440 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2b133-8c41-4cbf-ba9f-a09154228a17 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:02.557737 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2b133-8c41-4cbf-ba9f-a09154228a17 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:02.558174 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2b133-8c41-4cbf-ba9f-a09154228a17 None admin] PATH_INFO: `/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:02.559768 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2b133-8c41-4cbf-ba9f-a09154228a17 None admin] RBAC: Authorizing `identity:get_project(project_id=8ac4a2d636fc4ebdb5fd8e84d1834c46)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:02.561668 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2b133-8c41-4cbf-ba9f-a09154228a17 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:02.564094 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:02.564751 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 64/121] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:02 2022] GET /identity/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:02.566231 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a43c63-d51f-4bf5-be89-8f67b8857335 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:02.566681 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a43c63-d51f-4bf5-be89-8f67b8857335 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:02.567123 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a43c63-d51f-4bf5-be89-8f67b8857335 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:02.568660 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 65/122] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:02.569502 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a43c63-d51f-4bf5-be89-8f67b8857335 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:02.635188 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbaa9f-7342-44f3-ab28-6bb87f396734 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:02.691514 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a43c63-d51f-4bf5-be89-8f67b8857335 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:02.699995 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422caea-3839-4ea0-aa65-a8130337f7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:02.700923 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422caea-3839-4ea0-aa65-a8130337f7f2 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:02.701422 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422caea-3839-4ea0-aa65-a8130337f7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:02.702003 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422caea-3839-4ea0-aa65-a8130337f7f2 None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:02.702941 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422caea-3839-4ea0-aa65-a8130337f7f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:02.703585 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422caea-3839-4ea0-aa65-a8130337f7f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:02.705196 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422caea-3839-4ea0-aa65-a8130337f7f2 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:02.714527 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 58/123] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:02.715802 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422caea-3839-4ea0-aa65-a8130337f7f2 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:02.728570 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b959ffb-a5ba-4136-8b16-5e7f378b7aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:02.729212 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b959ffb-a5ba-4136-8b16-5e7f378b7aec None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:02.729501 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b959ffb-a5ba-4136-8b16-5e7f378b7aec None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:02.729829 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b959ffb-a5ba-4136-8b16-5e7f378b7aec None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:02.730579 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b959ffb-a5ba-4136-8b16-5e7f378b7aec None admin] RBAC: Adding query filter params (name=member) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:02.731094 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b959ffb-a5ba-4136-8b16-5e7f378b7aec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:02.732397 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b959ffb-a5ba-4136-8b16-5e7f378b7aec None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:02.734410 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:02.743592 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 66/124] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 16:12:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:02.750132 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cccf1-6806-4471-a309-adcfeed3e3df None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:02.750422 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cccf1-6806-4471-a309-adcfeed3e3df None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:02.750701 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cccf1-6806-4471-a309-adcfeed3e3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:02.770377 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-dc4cccf1-6806-4471-a309-adcfeed3e3df None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:02.771733 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-dc4cccf1-6806-4471-a309-adcfeed3e3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:02.828538 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422caea-3839-4ea0-aa65-a8130337f7f2 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:02.844607 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:02.856252 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 67/125] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:02.857271 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cccf1-6806-4471-a309-adcfeed3e3df None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:02.867025 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18cf93-00cb-4620-b79f-ecefc033431f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:02.868067 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18cf93-00cb-4620-b79f-ecefc033431f None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:02.868547 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18cf93-00cb-4620-b79f-ecefc033431f None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:02.869035 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18cf93-00cb-4620-b79f-ecefc033431f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:02.870019 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18cf93-00cb-4620-b79f-ecefc033431f None admin] RBAC: Adding query filter params (role.id=b9b668e0b625469fa54fa2eb74cbdb97, scope.project.id=8ac4a2d636fc4ebdb5fd8e84d1834c46, user.id=6944cc55ded644e7af8e7a198f3ba7dd) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:02.870531 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18cf93-00cb-4620-b79f-ecefc033431f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:02.872218 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18cf93-00cb-4620-b79f-ecefc033431f None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:02.878639 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 59/126] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 16:12:02 2022] GET /identity/v3/role_assignments?user.id=6944cc55ded644e7af8e7a198f3ba7dd&scope.project.id=8ac4a2d636fc4ebdb5fd8e84d1834c46&role.id=b9b668e0b625469fa54fa2eb74cbdb97 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:02.879843 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18cf93-00cb-4620-b79f-ecefc033431f None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:02.990243 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18cf93-00cb-4620-b79f-ecefc033431f None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:03.041078 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275bbc3-a7d5-4400-8547-c0a69aa2cab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:03.042238 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275bbc3-a7d5-4400-8547-c0a69aa2cab0 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:03.042724 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275bbc3-a7d5-4400-8547-c0a69aa2cab0 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:03.043197 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275bbc3-a7d5-4400-8547-c0a69aa2cab0 None admin] PATH_INFO: `/v3/users/b4367dec09b843eeafd691b9d6214a78` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:03.044858 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275bbc3-a7d5-4400-8547-c0a69aa2cab0 None admin] RBAC: Authorizing `identity:get_user(user_id=b4367dec09b843eeafd691b9d6214a78)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:03.046681 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275bbc3-a7d5-4400-8547-c0a69aa2cab0 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:03.049886 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 60/127] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:12:02 2022] GET /identity/v3/users/b4367dec09b843eeafd691b9d6214a78 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:03.052202 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275bbc3-a7d5-4400-8547-c0a69aa2cab0 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:03.080558 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cccf1-6806-4471-a309-adcfeed3e3df None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:03.151093 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:03.164495 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e3076-34f4-4002-bddf-99498d193582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:03.165669 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e3076-34f4-4002-bddf-99498d193582 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:03.166154 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e3076-34f4-4002-bddf-99498d193582 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:03.166652 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e3076-34f4-4002-bddf-99498d193582 None admin] PATH_INFO: `/v3/users/30d80e0d318d4f78a4aac8c796957981` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:03.167075 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:03.168775 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e3076-34f4-4002-bddf-99498d193582 None admin] RBAC: Authorizing `identity:get_user(user_id=30d80e0d318d4f78a4aac8c796957981)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:03.170737 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e3076-34f4-4002-bddf-99498d193582 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:03.173172 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 68/128] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:12:02 2022] GET /identity/v3/users/30d80e0d318d4f78a4aac8c796957981 => generated 247 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:03.174294 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e3076-34f4-4002-bddf-99498d193582 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:03.248694 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275bbc3-a7d5-4400-8547-c0a69aa2cab0 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:03.292138 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcd2cb-ec7e-4019-948d-56b4855745cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:03.293883 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcd2cb-ec7e-4019-948d-56b4855745cf None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:03.294396 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcd2cb-ec7e-4019-948d-56b4855745cf None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:03.294865 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcd2cb-ec7e-4019-948d-56b4855745cf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:03.309456 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbcd2cb-ec7e-4019-948d-56b4855745cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:03.312490 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e3076-34f4-4002-bddf-99498d193582 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:03.317534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-6dbcd2cb-ec7e-4019-948d-56b4855745cf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:12:03.317534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:03.317534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:03.317534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:03.317534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:03.317534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:03.317534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:03.317534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:03.317534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:03.317534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:03.317534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:03.317534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:03.317534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:03.317534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:03.317534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:03.317534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:03.318450 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:03.318450 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:03.318450 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:03.318450 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:03.318450 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:03.318450 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:03.318450 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:03.318450 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:03.318450 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:03.318450 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:03.318450 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:03.318450 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:03.318450 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:03.318450 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:03.318450 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:03.318450 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:03.319197 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:03.319197 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:03.319197 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:03.319197 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:03.319197 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:03.319197 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:03.319197 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:03.319197 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:03.319197 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:03.319197 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:03.319197 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:12:03.319197 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:12:03.321534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 61/129] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 16:12:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:03.322609 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcd2cb-ec7e-4019-948d-56b4855745cf None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:03.392106 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e2b20-e1b4-42e9-91bd-263b72d94d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:03.392785 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e2b20-e1b4-42e9-91bd-263b72d94d91 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:03.393150 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e2b20-e1b4-42e9-91bd-263b72d94d91 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:03.393353 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e2b20-e1b4-42e9-91bd-263b72d94d91 None admin] PATH_INFO: `/v3/projects/644ba54b11da4891b0be9e56d8e96b33` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:03.396473 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e2b20-e1b4-42e9-91bd-263b72d94d91 None admin] RBAC: Authorizing `identity:get_project(project_id=644ba54b11da4891b0be9e56d8e96b33)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:03.399204 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e2b20-e1b4-42e9-91bd-263b72d94d91 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:03.403184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 69/130] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:03 2022] GET /identity/v3/projects/644ba54b11da4891b0be9e56d8e96b33 => generated 312 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:03.408175 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e2b20-e1b4-42e9-91bd-263b72d94d91 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:03.451980 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcd2cb-ec7e-4019-948d-56b4855745cf None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:03.461753 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:03.492658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01aefe7-cae4-49ce-8021-715c201f6d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:03.494299 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01aefe7-cae4-49ce-8021-715c201f6d14 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:03.494783 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01aefe7-cae4-49ce-8021-715c201f6d14 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:03.495274 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01aefe7-cae4-49ce-8021-715c201f6d14 None admin] PATH_INFO: `/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:03.496924 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01aefe7-cae4-49ce-8021-715c201f6d14 None admin] RBAC: Authorizing `identity:get_project(project_id=8ac4a2d636fc4ebdb5fd8e84d1834c46)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:03.498565 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01aefe7-cae4-49ce-8021-715c201f6d14 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:03.501055 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 62/131] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:03 2022] GET /identity/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:03.502644 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01aefe7-cae4-49ce-8021-715c201f6d14 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:03.555779 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:03.617152 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01aefe7-cae4-49ce-8021-715c201f6d14 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:03.667540 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e2b20-e1b4-42e9-91bd-263b72d94d91 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:03.689997 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a0479-5360-4fa8-85dc-6801abc27d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:03.690696 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a0479-5360-4fa8-85dc-6801abc27d7c None admin] REQUEST_METHOD: `PUT` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:03.690976 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a0479-5360-4fa8-85dc-6801abc27d7c None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:03.691251 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a0479-5360-4fa8-85dc-6801abc27d7c None admin] PATH_INFO: `/v3/projects/644ba54b11da4891b0be9e56d8e96b33/users/b4367dec09b843eeafd691b9d6214a78/roles/5698bc4d332140e9af77ddcbb9915736` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:03.696675 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a0479-5360-4fa8-85dc-6801abc27d7c None admin] RBAC: Authorizing `identity:create_grant(project_id=644ba54b11da4891b0be9e56d8e96b33, user_id=b4367dec09b843eeafd691b9d6214a78, role_id=5698bc4d332140e9af77ddcbb9915736)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:03.698148 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a0479-5360-4fa8-85dc-6801abc27d7c None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:03.713679 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9ee85-2eab-4d09-8106-3d214746f356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:03.714867 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9ee85-2eab-4d09-8106-3d214746f356 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:03.715292 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9ee85-2eab-4d09-8106-3d214746f356 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:03.715785 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9ee85-2eab-4d09-8106-3d214746f356 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:03.716893 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9ee85-2eab-4d09-8106-3d214746f356 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:03.717416 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9ee85-2eab-4d09-8106-3d214746f356 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:03.721310 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9ee85-2eab-4d09-8106-3d214746f356 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:03.727548 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 63/132] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 16:12:03 2022] PUT /identity/v3/projects/644ba54b11da4891b0be9e56d8e96b33/users/b4367dec09b843eeafd691b9d6214a78/roles/5698bc4d332140e9af77ddcbb9915736 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:12:03.729283 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a0479-5360-4fa8-85dc-6801abc27d7c None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:03.746634 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 70/133] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:12:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:03.756675 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9ee85-2eab-4d09-8106-3d214746f356 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:03.819481 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:03.944146 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a0479-5360-4fa8-85dc-6801abc27d7c None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:03.956118 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9ee85-2eab-4d09-8106-3d214746f356 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:03.995227 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:04.012206 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43e779-fb5f-49df-877d-27d5ff3e967b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:04.012825 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43e779-fb5f-49df-877d-27d5ff3e967b None admin] REQUEST_METHOD: `PUT` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:04.013110 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43e779-fb5f-49df-877d-27d5ff3e967b None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:04.013387 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43e779-fb5f-49df-877d-27d5ff3e967b None admin] PATH_INFO: `/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46/users/30d80e0d318d4f78a4aac8c796957981/roles/76e01abae9964dd5b28fc8895f739ee4` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:04.016069 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43e779-fb5f-49df-877d-27d5ff3e967b None admin] RBAC: Authorizing `identity:create_grant(project_id=8ac4a2d636fc4ebdb5fd8e84d1834c46, user_id=30d80e0d318d4f78a4aac8c796957981, role_id=76e01abae9964dd5b28fc8895f739ee4)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:04.017524 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43e779-fb5f-49df-877d-27d5ff3e967b None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:04.020950 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980a74a-3772-4693-949b-1e31005d5b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:04.021623 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980a74a-3772-4693-949b-1e31005d5b75 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:04.021909 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980a74a-3772-4693-949b-1e31005d5b75 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:04.022187 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980a74a-3772-4693-949b-1e31005d5b75 None admin] PATH_INFO: `/v3/users/b4367dec09b843eeafd691b9d6214a78` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:04.023454 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980a74a-3772-4693-949b-1e31005d5b75 None admin] RBAC: Authorizing `identity:get_user(user_id=b4367dec09b843eeafd691b9d6214a78)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:04.024939 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980a74a-3772-4693-949b-1e31005d5b75 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:04.026558 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 71/134] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:12:03 2022] GET /identity/v3/users/b4367dec09b843eeafd691b9d6214a78 => generated 275 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:04.039198 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980a74a-3772-4693-949b-1e31005d5b75 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:04.044917 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 64/135] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 16:12:03 2022] PUT /identity/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46/users/30d80e0d318d4f78a4aac8c796957981/roles/76e01abae9964dd5b28fc8895f739ee4 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:12:04.206211 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980a74a-3772-4693-949b-1e31005d5b75 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:04.256443 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270780d0-352a-4878-9af8-82a594dd6b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:04.257123 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270780d0-352a-4878-9af8-82a594dd6b26 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:04.257416 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270780d0-352a-4878-9af8-82a594dd6b26 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:04.257701 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270780d0-352a-4878-9af8-82a594dd6b26 None admin] PATH_INFO: `/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:04.259959 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270780d0-352a-4878-9af8-82a594dd6b26 None admin] RBAC: Authorizing `identity:get_project(project_id=8ac4a2d636fc4ebdb5fd8e84d1834c46)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:04.261483 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270780d0-352a-4878-9af8-82a594dd6b26 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:04.263317 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 72/136] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:04 2022] GET /identity/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:04.269407 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43e779-fb5f-49df-877d-27d5ff3e967b None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:04.393082 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:04.399939 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43e779-fb5f-49df-877d-27d5ff3e967b None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:04.440157 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26884845-1b78-43f0-8fcc-a78411e820e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:04.440863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26884845-1b78-43f0-8fcc-a78411e820e5 None admin] REQUEST_METHOD: `PUT` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:04.441245 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26884845-1b78-43f0-8fcc-a78411e820e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:04.441532 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26884845-1b78-43f0-8fcc-a78411e820e5 None admin] PATH_INFO: `/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46/users/b4367dec09b843eeafd691b9d6214a78/roles/cdb6d97b8d4a41e8aaec05181b77fada` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:04.443871 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26884845-1b78-43f0-8fcc-a78411e820e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ac4a2d636fc4ebdb5fd8e84d1834c46, user_id=b4367dec09b843eeafd691b9d6214a78, role_id=cdb6d97b8d4a41e8aaec05181b77fada)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:04.445403 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26884845-1b78-43f0-8fcc-a78411e820e5 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:04.468498 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 65/137] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 16:12:04 2022] PUT /identity/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46/users/b4367dec09b843eeafd691b9d6214a78/roles/cdb6d97b8d4a41e8aaec05181b77fada => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:12:04.696817 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b822b-6d72-45dc-a1e4-1bdb61c03c0e None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:04.697346 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b822b-6d72-45dc-a1e4-1bdb61c03c0e None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:04.697421 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b822b-6d72-45dc-a1e4-1bdb61c03c0e None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:04.698903 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 73/138] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:04.705533 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dbc26-4270-4e49-bcbf-b06bf4c06516 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:04.706174 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dbc26-4270-4e49-bcbf-b06bf4c06516 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:04.706652 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dbc26-4270-4e49-bcbf-b06bf4c06516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:04.736260 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-d59dbc26-4270-4e49-bcbf-b06bf4c06516 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:04.737896 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-d59dbc26-4270-4e49-bcbf-b06bf4c06516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:04.828859 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 66/139] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:12:04.853715 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b822b-6d72-45dc-a1e4-1bdb61c03c0e None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:04.912674 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b47f0c-8cc2-4ba9-8501-32ef5f8b4b99 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:04.913296 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b47f0c-8cc2-4ba9-8501-32ef5f8b4b99 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:04.913795 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b47f0c-8cc2-4ba9-8501-32ef5f8b4b99 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:04.915352 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 67/140] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:12:04.921754 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45b1e5-9495-4b61-b107-7f16293a06ff None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:04.922334 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45b1e5-9495-4b61-b107-7f16293a06ff None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:04.922805 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45b1e5-9495-4b61-b107-7f16293a06ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:04.952046 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:04.952947 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-1c45b1e5-9495-4b61-b107-7f16293a06ff None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:04.954185 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-1c45b1e5-9495-4b61-b107-7f16293a06ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:05.006818 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b822b-6d72-45dc-a1e4-1bdb61c03c0e None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:05.076521 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3894c6-349e-4e0a-92d3-a68f138aadda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:05.078054 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3894c6-349e-4e0a-92d3-a68f138aadda None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:05.078655 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3894c6-349e-4e0a-92d3-a68f138aadda None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:05.079727 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3894c6-349e-4e0a-92d3-a68f138aadda None admin] PATH_INFO: `/v3/roles/member` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:05.099955 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 68/141] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:12:05.101249 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3894c6-349e-4e0a-92d3-a68f138aadda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:05.106950 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-8f3894c6-349e-4e0a-92d3-a68f138aadda None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:12:05.106950 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:05.106950 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:05.106950 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:05.106950 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:05.106950 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:05.106950 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:05.106950 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:05.106950 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:05.106950 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:05.106950 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:05.106950 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:05.106950 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:05.106950 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:05.106950 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:05.106950 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:05.107821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:05.107821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:05.107821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:05.107821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:05.107821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:05.107821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:05.107821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:05.107821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:05.107821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:05.107821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:05.107821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:05.107821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:05.107821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:05.107821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:05.107821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:05.107821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:05.109171 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:05.109171 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:05.109171 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:05.109171 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:05.109171 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:05.109171 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:05.109171 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:05.109171 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:05.109171 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:05.109171 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:05.109171 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:12:05.109171 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:05.112026 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 74/142] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:05.120475 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45b1e5-9495-4b61-b107-7f16293a06ff None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:05.138460 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3894c6-349e-4e0a-92d3-a68f138aadda None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:05.149178 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:05.323627 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45b1e5-9495-4b61-b107-7f16293a06ff None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:05.335906 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3894c6-349e-4e0a-92d3-a68f138aadda None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:05.371126 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99c3fa-4ecf-4cb8-b7d4-fdc4c736a97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:05.371917 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99c3fa-4ecf-4cb8-b7d4-fdc4c736a97b None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:05.372213 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99c3fa-4ecf-4cb8-b7d4-fdc4c736a97b None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:05.372493 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99c3fa-4ecf-4cb8-b7d4-fdc4c736a97b None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:05.373227 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99c3fa-4ecf-4cb8-b7d4-fdc4c736a97b None admin] RBAC: Adding query filter params (name=member) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:05.373543 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99c3fa-4ecf-4cb8-b7d4-fdc4c736a97b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:05.375479 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99c3fa-4ecf-4cb8-b7d4-fdc4c736a97b None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:05.382348 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:05.400542 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 69/143] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 16:12:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:05.406310 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99c3fa-4ecf-4cb8-b7d4-fdc4c736a97b None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:05.407743 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2431b-ca61-493d-a369-ba61b12210f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:05.408677 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2431b-ca61-493d-a369-ba61b12210f1 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:05.409176 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2431b-ca61-493d-a369-ba61b12210f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:05.409667 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2431b-ca61-493d-a369-ba61b12210f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:05.411045 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f2431b-ca61-493d-a369-ba61b12210f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:05.413009 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f2431b-ca61-493d-a369-ba61b12210f1 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:05.414913 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 75/144] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:12:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:05.422468 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2431b-ca61-493d-a369-ba61b12210f1 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:05.519359 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:05.549415 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99c3fa-4ecf-4cb8-b7d4-fdc4c736a97b None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:05.600203 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a23292-8b37-415a-b290-4daad27d6f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:05.600804 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a23292-8b37-415a-b290-4daad27d6f08 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:05.601098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a23292-8b37-415a-b290-4daad27d6f08 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:05.601381 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a23292-8b37-415a-b290-4daad27d6f08 None admin] PATH_INFO: `/v3/users/b4367dec09b843eeafd691b9d6214a78` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:05.608128 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a23292-8b37-415a-b290-4daad27d6f08 None admin] RBAC: Authorizing `identity:get_user(user_id=b4367dec09b843eeafd691b9d6214a78)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:05.610171 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a23292-8b37-415a-b290-4daad27d6f08 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:05.611858 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 70/145] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:12:05 2022] GET /identity/v3/users/b4367dec09b843eeafd691b9d6214a78 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:05.617324 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a23292-8b37-415a-b290-4daad27d6f08 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:05.627097 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2431b-ca61-493d-a369-ba61b12210f1 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:05.693139 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785b753-a1f8-46bf-92db-180213dc8125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:05.694022 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785b753-a1f8-46bf-92db-180213dc8125 None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:05.694456 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785b753-a1f8-46bf-92db-180213dc8125 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:05.694880 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785b753-a1f8-46bf-92db-180213dc8125 None admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:05.695792 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785b753-a1f8-46bf-92db-180213dc8125 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:05.697555 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785b753-a1f8-46bf-92db-180213dc8125 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:05.742741 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 76/146] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 16:12:05 2022] POST /identity/v3/users => generated 283 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:12:05.859867 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a23292-8b37-415a-b290-4daad27d6f08 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:05.896778 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a03e1-1801-4c80-915a-ebb9b40f058a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:05.897431 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a03e1-1801-4c80-915a-ebb9b40f058a None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:05.897748 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a03e1-1801-4c80-915a-ebb9b40f058a None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:05.898037 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a03e1-1801-4c80-915a-ebb9b40f058a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:05.915016 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:05.982703 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a03e1-1801-4c80-915a-ebb9b40f058a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:05.984261 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a03e1-1801-4c80-915a-ebb9b40f058a None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:06.024960 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9942f0-ccdb-42cc-8ea5-6c33279f0405 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:06.024960 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9942f0-ccdb-42cc-8ea5-6c33279f0405 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:06.024960 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9942f0-ccdb-42cc-8ea5-6c33279f0405 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:06.024960 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 77/147] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:12:06.045043 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee04be-d0ab-4b19-ba5a-85e0ba3ab396 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:06.045700 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee04be-d0ab-4b19-ba5a-85e0ba3ab396 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:06.046227 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee04be-d0ab-4b19-ba5a-85e0ba3ab396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:06.078186 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-94ee04be-d0ab-4b19-ba5a-85e0ba3ab396 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:06.080745 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-94ee04be-d0ab-4b19-ba5a-85e0ba3ab396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:06.151907 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:06.196868 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 71/148] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:12:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 16:12:06.206874 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a03e1-1801-4c80-915a-ebb9b40f058a None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:06.220810 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 78/149] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:12:06.269290 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:06.325842 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee04be-d0ab-4b19-ba5a-85e0ba3ab396 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:06.343941 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a03e1-1801-4c80-915a-ebb9b40f058a None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:06.383515 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c59739-cb9d-4d57-880d-e283cdb5c790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:06.384628 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c59739-cb9d-4d57-880d-e283cdb5c790 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:06.385115 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c59739-cb9d-4d57-880d-e283cdb5c790 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:06.385717 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c59739-cb9d-4d57-880d-e283cdb5c790 None admin] PATH_INFO: `/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:06.387118 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c59739-cb9d-4d57-880d-e283cdb5c790 None admin] RBAC: Authorizing `identity:get_project(project_id=8ac4a2d636fc4ebdb5fd8e84d1834c46)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:06.388952 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c59739-cb9d-4d57-880d-e283cdb5c790 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:06.391790 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 72/150] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:06 2022] GET /identity/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:06.399808 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c59739-cb9d-4d57-880d-e283cdb5c790 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:06.473464 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee04be-d0ab-4b19-ba5a-85e0ba3ab396 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:06.522104 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39908ba-c828-4b84-9ee4-78d326dc3e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:06.522791 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39908ba-c828-4b84-9ee4-78d326dc3e76 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:06.523056 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39908ba-c828-4b84-9ee4-78d326dc3e76 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:06.523335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39908ba-c828-4b84-9ee4-78d326dc3e76 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:06.542605 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39908ba-c828-4b84-9ee4-78d326dc3e76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:06.548157 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-f39908ba-c828-4b84-9ee4-78d326dc3e76 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:12:06.548157 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:06.548157 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:06.548157 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:06.548157 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:06.548157 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:06.548157 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:06.548157 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:06.548157 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:06.548157 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:06.548157 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:06.548157 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:06.548157 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:06.548157 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:06.548157 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:06.548157 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:06.548991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:06.548991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:06.548991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:06.548991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:06.548991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:06.548991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:06.548991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:06.548991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:06.548991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:06.548991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:06.548991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:06.548991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:06.548991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:06.548991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:06.548991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:06.548991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:06.549756 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:06.549756 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:06.549756 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:06.549756 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:06.549756 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:06.549756 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:06.549756 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:06.549756 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:06.549756 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:06.549756 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:06.549756 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:12:06.549756 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:06.550957 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 79/151] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:06.556577 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39908ba-c828-4b84-9ee4-78d326dc3e76 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:06.566916 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c59739-cb9d-4d57-880d-e283cdb5c790 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:06.583197 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:06.616547 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:06.633822 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be53dda-e8ae-49e0-8252-721dad38d294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:06.634464 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be53dda-e8ae-49e0-8252-721dad38d294 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:06.634751 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be53dda-e8ae-49e0-8252-721dad38d294 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:06.635032 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be53dda-e8ae-49e0-8252-721dad38d294 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:06.635861 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be53dda-e8ae-49e0-8252-721dad38d294 None admin] RBAC: Adding query filter params (role.id=5698bc4d332140e9af77ddcbb9915736, scope.project.id=8ac4a2d636fc4ebdb5fd8e84d1834c46, user.id=b4367dec09b843eeafd691b9d6214a78) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:06.636175 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be53dda-e8ae-49e0-8252-721dad38d294 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:06.637630 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be53dda-e8ae-49e0-8252-721dad38d294 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:06.648339 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 73/152] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 16:12:06 2022] GET /identity/v3/role_assignments?user.id=b4367dec09b843eeafd691b9d6214a78&scope.project.id=8ac4a2d636fc4ebdb5fd8e84d1834c46&role.id=5698bc4d332140e9af77ddcbb9915736 => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:06.723596 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39908ba-c828-4b84-9ee4-78d326dc3e76 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:06.772122 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709a694-aa69-4890-8d49-1f2b475fb14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:06.772756 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709a694-aa69-4890-8d49-1f2b475fb14a None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:06.773046 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709a694-aa69-4890-8d49-1f2b475fb14a None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:06.773325 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709a694-aa69-4890-8d49-1f2b475fb14a None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:06.774054 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709a694-aa69-4890-8d49-1f2b475fb14a None admin] RBAC: Adding query filter params (name=reader) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:06.774483 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709a694-aa69-4890-8d49-1f2b475fb14a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:06.775794 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709a694-aa69-4890-8d49-1f2b475fb14a None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:06.791895 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 80/153] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 16:12:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:06.798573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be53dda-e8ae-49e0-8252-721dad38d294 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:06.915597 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be53dda-e8ae-49e0-8252-721dad38d294 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:06.956002 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f575c-ee46-4eab-a8c6-26257f50a582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:06.956674 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f575c-ee46-4eab-a8c6-26257f50a582 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:06.956965 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f575c-ee46-4eab-a8c6-26257f50a582 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:06.957245 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f575c-ee46-4eab-a8c6-26257f50a582 None admin] PATH_INFO: `/v3/users/6944cc55ded644e7af8e7a198f3ba7dd` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:06.958454 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f575c-ee46-4eab-a8c6-26257f50a582 None admin] RBAC: Authorizing `identity:get_user(user_id=6944cc55ded644e7af8e7a198f3ba7dd)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:06.959949 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f575c-ee46-4eab-a8c6-26257f50a582 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:06.961573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 74/154] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:12:06 2022] GET /identity/v3/users/6944cc55ded644e7af8e7a198f3ba7dd => generated 289 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:06.967515 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709a694-aa69-4890-8d49-1f2b475fb14a None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:07.094336 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:07.104447 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709a694-aa69-4890-8d49-1f2b475fb14a None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:07.151692 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39863df9-f14d-4f7e-94ea-911b8631befe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:07.152356 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39863df9-f14d-4f7e-94ea-911b8631befe None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:07.152648 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39863df9-f14d-4f7e-94ea-911b8631befe None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:07.152926 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39863df9-f14d-4f7e-94ea-911b8631befe None admin] PATH_INFO: `/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:07.154174 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39863df9-f14d-4f7e-94ea-911b8631befe None admin] RBAC: Authorizing `identity:get_project(project_id=8ac4a2d636fc4ebdb5fd8e84d1834c46)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:07.155746 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39863df9-f14d-4f7e-94ea-911b8631befe None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:07.157794 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 81/155] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:06 2022] GET /identity/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:07.163576 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f575c-ee46-4eab-a8c6-26257f50a582 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:07.220627 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:07.291153 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f575c-ee46-4eab-a8c6-26257f50a582 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:07.339755 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65523dc4-79d2-4280-8988-16743d3630ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:07.340450 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65523dc4-79d2-4280-8988-16743d3630ce None admin] REQUEST_METHOD: `PUT` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:07.340741 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65523dc4-79d2-4280-8988-16743d3630ce None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:07.341026 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65523dc4-79d2-4280-8988-16743d3630ce None admin] PATH_INFO: `/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46/users/6944cc55ded644e7af8e7a198f3ba7dd/roles/b9b668e0b625469fa54fa2eb74cbdb97` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:07.343113 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65523dc4-79d2-4280-8988-16743d3630ce None admin] RBAC: Authorizing `identity:create_grant(project_id=8ac4a2d636fc4ebdb5fd8e84d1834c46, user_id=6944cc55ded644e7af8e7a198f3ba7dd, role_id=b9b668e0b625469fa54fa2eb74cbdb97)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:07.344660 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65523dc4-79d2-4280-8988-16743d3630ce None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:07.367914 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 75/156] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 16:12:07 2022] PUT /identity/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46/users/6944cc55ded644e7af8e7a198f3ba7dd/roles/b9b668e0b625469fa54fa2eb74cbdb97 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:12:07.394981 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd04b1-69ec-4ed3-9bcf-69ddb9352cb9 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:07.395414 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd04b1-69ec-4ed3-9bcf-69ddb9352cb9 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:07.395633 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd04b1-69ec-4ed3-9bcf-69ddb9352cb9 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:07.397246 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 82/157] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:07.403052 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599e45f-ad93-4212-9845-c6e1078871c9 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:07.403350 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599e45f-ad93-4212-9845-c6e1078871c9 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:07.403665 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599e45f-ad93-4212-9845-c6e1078871c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:07.433027 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-7599e45f-ad93-4212-9845-c6e1078871c9 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:07.434271 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-7599e45f-ad93-4212-9845-c6e1078871c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:07.523718 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 76/158] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:07.564055 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd04b1-69ec-4ed3-9bcf-69ddb9352cb9 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:07.645299 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca796d3b-c100-4f01-9783-37bda78049f9 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:07.645783 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca796d3b-c100-4f01-9783-37bda78049f9 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:07.646107 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca796d3b-c100-4f01-9783-37bda78049f9 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:07.647634 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 77/159] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:07.656415 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365f5e4-c8e4-4176-9597-44956c382d68 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:07.656721 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365f5e4-c8e4-4176-9597-44956c382d68 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:07.656969 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365f5e4-c8e4-4176-9597-44956c382d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:07.682602 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-5365f5e4-c8e4-4176-9597-44956c382d68 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:07.683910 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-5365f5e4-c8e4-4176-9597-44956c382d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:07.725838 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:07.736810 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd04b1-69ec-4ed3-9bcf-69ddb9352cb9 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:07.782408 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 78/160] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:07.783486 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8116c-8545-47fc-94b6-ff35748d9dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:07.784387 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8116c-8545-47fc-94b6-ff35748d9dcc None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:07.784863 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8116c-8545-47fc-94b6-ff35748d9dcc None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:07.785341 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8116c-8545-47fc-94b6-ff35748d9dcc None admin] PATH_INFO: `/v3/roles/member` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:07.798426 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8116c-8545-47fc-94b6-ff35748d9dcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:07.804328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-d5f8116c-8545-47fc-94b6-ff35748d9dcc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:12:07.804328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:07.804328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:07.804328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:07.804328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:07.804328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:07.804328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:07.804328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:07.804328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:07.804328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:07.804328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:07.804328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:07.804328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:07.804328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:07.804328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:07.804328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:07.805217 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:07.805217 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:07.805217 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:07.805217 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:07.805217 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:07.805217 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:07.805217 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:07.805217 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:07.805217 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:07.805217 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:07.805217 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:07.805217 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:07.805217 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:07.805217 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:07.805217 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:07.805217 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:07.805968 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:07.805968 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:07.805968 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:07.805968 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:07.805968 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:07.805968 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:07.805968 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:07.805968 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:07.805968 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:07.805968 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:07.805968 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:12:07.805968 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:07.807011 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365f5e4-c8e4-4176-9597-44956c382d68 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:07.809116 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 83/161] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:07.816446 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8116c-8545-47fc-94b6-ff35748d9dcc None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:07.847288 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:07.941509 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8116c-8545-47fc-94b6-ff35748d9dcc None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:07.987081 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7eee64-78f7-4a5d-8b93-14f13730a054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:07.988087 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7eee64-78f7-4a5d-8b93-14f13730a054 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:07.989280 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7eee64-78f7-4a5d-8b93-14f13730a054 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:07.989772 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7eee64-78f7-4a5d-8b93-14f13730a054 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:08.000414 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7eee64-78f7-4a5d-8b93-14f13730a054 None admin] RBAC: Adding query filter params (name=member) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:08.000733 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7eee64-78f7-4a5d-8b93-14f13730a054 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:08.002185 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7eee64-78f7-4a5d-8b93-14f13730a054 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:08.020595 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 84/162] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 16:12:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:08.022512 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae988b-bf87-43a4-a818-aec54594859c None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:08.022953 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae988b-bf87-43a4-a818-aec54594859c None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:08.023409 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae988b-bf87-43a4-a818-aec54594859c None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:08.031614 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365f5e4-c8e4-4176-9597-44956c382d68 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:08.033640 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 85/163] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:08 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:08.035329 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae988b-bf87-43a4-a818-aec54594859c None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:08.078016 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8eaffa-0752-43ac-bfc9-0e6743f3b30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:08.079016 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8eaffa-0752-43ac-bfc9-0e6743f3b30e None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:08.079552 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8eaffa-0752-43ac-bfc9-0e6743f3b30e None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:08.080018 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8eaffa-0752-43ac-bfc9-0e6743f3b30e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:08.101078 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8eaffa-0752-43ac-bfc9-0e6743f3b30e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:08.106551 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-ba8eaffa-0752-43ac-bfc9-0e6743f3b30e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:12:08.106551 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:08.106551 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:08.106551 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:08.106551 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:08.106551 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:08.106551 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:08.106551 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:08.106551 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:08.106551 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:08.106551 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:08.106551 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:08.106551 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:08.106551 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:08.106551 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:08.106551 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:08.107415 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:08.107415 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:08.107415 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:08.107415 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:08.107415 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:08.107415 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:08.107415 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:08.107415 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:08.107415 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:08.107415 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:08.107415 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:08.107415 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:08.107415 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:08.107415 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:08.107415 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:08.107415 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:08.108193 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:08.108193 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:08.108193 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:08.108193 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:08.108193 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:08.108193 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:08.108193 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:08.108193 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:08.108193 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:08.108193 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:08.108193 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:12:08.108193 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:12:08.110893 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 79/164] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 16:12:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:12:08.116433 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c4b41-b571-42e8-ac85-e467e519ef31 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:08.117006 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c4b41-b571-42e8-ac85-e467e519ef31 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:08.117477 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c4b41-b571-42e8-ac85-e467e519ef31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:08.148445 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-574c4b41-b571-42e8-ac85-e467e519ef31 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:08.149990 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-574c4b41-b571-42e8-ac85-e467e519ef31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:08.179155 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:08.226599 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:08.237291 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 80/165] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:08.238323 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c4b41-b571-42e8-ac85-e467e519ef31 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:08.284134 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae988b-bf87-43a4-a818-aec54594859c None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:08.350290 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c4b41-b571-42e8-ac85-e467e519ef31 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:08.373077 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e042433-e77e-411a-bdcd-cb7ba8349dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:08.373751 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e042433-e77e-411a-bdcd-cb7ba8349dc7 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:08.374576 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e042433-e77e-411a-bdcd-cb7ba8349dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:08.374878 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e042433-e77e-411a-bdcd-cb7ba8349dc7 None admin] PATH_INFO: `/v3/users/b4367dec09b843eeafd691b9d6214a78` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:08.380096 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e042433-e77e-411a-bdcd-cb7ba8349dc7 None admin] RBAC: Authorizing `identity:get_user(user_id=b4367dec09b843eeafd691b9d6214a78)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:08.381606 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e042433-e77e-411a-bdcd-cb7ba8349dc7 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:08.383622 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 86/166] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:12:08 2022] GET /identity/v3/users/b4367dec09b843eeafd691b9d6214a78 => generated 275 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:08.384520 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e042433-e77e-411a-bdcd-cb7ba8349dc7 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:08.395437 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480aa4f9-c856-4f2b-9f01-952bb96a9496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:08.395437 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480aa4f9-c856-4f2b-9f01-952bb96a9496 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:08.395437 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480aa4f9-c856-4f2b-9f01-952bb96a9496 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:08.395437 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480aa4f9-c856-4f2b-9f01-952bb96a9496 None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:08.396048 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480aa4f9-c856-4f2b-9f01-952bb96a9496 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:08.396048 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480aa4f9-c856-4f2b-9f01-952bb96a9496 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:08.396048 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480aa4f9-c856-4f2b-9f01-952bb96a9496 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:08.404435 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 81/167] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:12:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:08.405341 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480aa4f9-c856-4f2b-9f01-952bb96a9496 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:08.427948 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:08.545572 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480aa4f9-c856-4f2b-9f01-952bb96a9496 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:08.640931 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce426d-cb72-4080-a226-08185b434f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:08.642696 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce426d-cb72-4080-a226-08185b434f8d None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:08.643781 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce426d-cb72-4080-a226-08185b434f8d None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:08.644420 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce426d-cb72-4080-a226-08185b434f8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:08.647504 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e042433-e77e-411a-bdcd-cb7ba8349dc7 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:08.746980 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1889c5-589e-460a-9eb5-e9bf40916b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:08.747779 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1889c5-589e-460a-9eb5-e9bf40916b03 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:08.747945 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1889c5-589e-460a-9eb5-e9bf40916b03 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:08.748223 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1889c5-589e-460a-9eb5-e9bf40916b03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:08.776390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1889c5-589e-460a-9eb5-e9bf40916b03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:08.786139 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-2c1889c5-589e-460a-9eb5-e9bf40916b03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:12:08.786139 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:08.786139 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:08.786139 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:08.786139 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:08.786139 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:08.786139 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:08.786139 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:08.786139 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:08.786139 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:08.786139 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:08.786139 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:08.786139 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:08.786139 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:08.786139 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:08.786139 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:08.787398 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:08.787398 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:08.787398 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:08.787398 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:08.787398 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:08.787398 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:08.787398 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:08.787398 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:08.787398 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:08.787398 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:08.787398 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:08.787398 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:08.787398 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:08.787398 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:08.787398 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:08.787398 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:08.788600 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:08.788600 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:08.788600 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:08.788600 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:08.788600 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:08.788600 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:08.788600 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:08.788600 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:08.788600 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:08.788600 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:08.788600 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:12:08.788600 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:08.788600 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 87/168] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 16:12:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:08.789246 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1889c5-589e-460a-9eb5-e9bf40916b03 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:08.810174 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:08.860681 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce426d-cb72-4080-a226-08185b434f8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:08.862796 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce426d-cb72-4080-a226-08185b434f8d None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:08.902704 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:08.911474 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1889c5-589e-460a-9eb5-e9bf40916b03 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:08.953509 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263bf4e-d74d-4a0f-9108-baa017998c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:08.954165 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263bf4e-d74d-4a0f-9108-baa017998c0a None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:08.954447 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263bf4e-d74d-4a0f-9108-baa017998c0a None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:08.954723 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263bf4e-d74d-4a0f-9108-baa017998c0a None admin] PATH_INFO: `/v3/users/b4367dec09b843eeafd691b9d6214a78` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:08.955938 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263bf4e-d74d-4a0f-9108-baa017998c0a None admin] RBAC: Authorizing `identity:get_user(user_id=b4367dec09b843eeafd691b9d6214a78)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:08.957694 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263bf4e-d74d-4a0f-9108-baa017998c0a None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:08.959741 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 88/169] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:12:08 2022] GET /identity/v3/users/b4367dec09b843eeafd691b9d6214a78 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:08.960907 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263bf4e-d74d-4a0f-9108-baa017998c0a None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:09.055749 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:09.073306 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263bf4e-d74d-4a0f-9108-baa017998c0a None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:09.112021 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434fd8e-db38-46a4-9f0e-f2adecfa0c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:09.113017 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434fd8e-db38-46a4-9f0e-f2adecfa0c02 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:09.113505 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434fd8e-db38-46a4-9f0e-f2adecfa0c02 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:09.113982 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434fd8e-db38-46a4-9f0e-f2adecfa0c02 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:09.114903 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a434fd8e-db38-46a4-9f0e-f2adecfa0c02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:09.115434 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a434fd8e-db38-46a4-9f0e-f2adecfa0c02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:09.117136 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a434fd8e-db38-46a4-9f0e-f2adecfa0c02 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:09.134379 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 89/170] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:09.141705 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434fd8e-db38-46a4-9f0e-f2adecfa0c02 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:09.159413 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 82/171] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:12:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 748 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:12:09.162848 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce426d-cb72-4080-a226-08185b434f8d None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:09.328521 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434fd8e-db38-46a4-9f0e-f2adecfa0c02 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:09.389297 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21020e70-2a06-48d9-9b57-bc7f064c34f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:09.390872 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21020e70-2a06-48d9-9b57-bc7f064c34f0 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:09.396406 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21020e70-2a06-48d9-9b57-bc7f064c34f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:09.396939 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21020e70-2a06-48d9-9b57-bc7f064c34f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:09.435362 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce426d-cb72-4080-a226-08185b434f8d None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:09.440010 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:09.476060 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:09.518325 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523c5b8-43e6-4a51-98f7-98405fd1f37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:09.519896 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523c5b8-43e6-4a51-98f7-98405fd1f37c None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:09.522238 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523c5b8-43e6-4a51-98f7-98405fd1f37c None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:09.522940 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523c5b8-43e6-4a51-98f7-98405fd1f37c None admin] PATH_INFO: `/v3/users/30d80e0d318d4f78a4aac8c796957981` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:09.526214 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523c5b8-43e6-4a51-98f7-98405fd1f37c None admin] RBAC: Authorizing `identity:get_user(user_id=30d80e0d318d4f78a4aac8c796957981)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:09.530103 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523c5b8-43e6-4a51-98f7-98405fd1f37c None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:09.534901 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 83/172] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:12:09 2022] GET /identity/v3/users/30d80e0d318d4f78a4aac8c796957981 => generated 247 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:09.538725 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523c5b8-43e6-4a51-98f7-98405fd1f37c None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:09.570222 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21020e70-2a06-48d9-9b57-bc7f064c34f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:09.572104 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21020e70-2a06-48d9-9b57-bc7f064c34f0 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:09.677205 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523c5b8-43e6-4a51-98f7-98405fd1f37c None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:09.725450 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb472af-5560-42f1-9c51-8c68cf3d2abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:09.726791 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb472af-5560-42f1-9c51-8c68cf3d2abd None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:09.727955 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb472af-5560-42f1-9c51-8c68cf3d2abd None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:09.728481 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb472af-5560-42f1-9c51-8c68cf3d2abd None admin] PATH_INFO: `/v3/projects/644ba54b11da4891b0be9e56d8e96b33` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:09.731303 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb472af-5560-42f1-9c51-8c68cf3d2abd None admin] RBAC: Authorizing `identity:get_project(project_id=644ba54b11da4891b0be9e56d8e96b33)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:09.733023 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb472af-5560-42f1-9c51-8c68cf3d2abd None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:09.740847 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 84/173] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:09 2022] GET /identity/v3/projects/644ba54b11da4891b0be9e56d8e96b33 => generated 312 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:09.743358 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb472af-5560-42f1-9c51-8c68cf3d2abd None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:09.808216 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 90/174] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:12:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:12:09.810780 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21020e70-2a06-48d9-9b57-bc7f064c34f0 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:09.853026 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:09.917076 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:09.968595 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb472af-5560-42f1-9c51-8c68cf3d2abd None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:10.050500 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdca8a-601b-459c-8434-3360bf567b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:10.051593 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdca8a-601b-459c-8434-3360bf567b53 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:10.051884 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdca8a-601b-459c-8434-3360bf567b53 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:10.052162 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdca8a-601b-459c-8434-3360bf567b53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:10.065643 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21020e70-2a06-48d9-9b57-bc7f064c34f0 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:10.136996 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c938e-dc99-44af-b8c7-039d7d195999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:10.138018 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c938e-dc99-44af-b8c7-039d7d195999 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:10.138512 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c938e-dc99-44af-b8c7-039d7d195999 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:10.139005 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c938e-dc99-44af-b8c7-039d7d195999 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:10.140583 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c938e-dc99-44af-b8c7-039d7d195999 None admin] RBAC: Adding query filter params (role.id=5698bc4d332140e9af77ddcbb9915736, scope.project.id=644ba54b11da4891b0be9e56d8e96b33, user.id=b4367dec09b843eeafd691b9d6214a78) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:10.141117 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c938e-dc99-44af-b8c7-039d7d195999 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:10.142769 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c938e-dc99-44af-b8c7-039d7d195999 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:10.159118 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 91/175] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 16:12:09 2022] GET /identity/v3/role_assignments?user.id=b4367dec09b843eeafd691b9d6214a78&scope.project.id=644ba54b11da4891b0be9e56d8e96b33&role.id=5698bc4d332140e9af77ddcbb9915736 => generated 608 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:10.160337 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c938e-dc99-44af-b8c7-039d7d195999 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:10.220647 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccdca8a-601b-459c-8434-3360bf567b53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:10.222041 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccdca8a-601b-459c-8434-3360bf567b53 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:10.320207 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:10.373649 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c938e-dc99-44af-b8c7-039d7d195999 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:10.391052 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:10.399435 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 85/176] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:12:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:12:10.414455 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdca8a-601b-459c-8434-3360bf567b53 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:10.441081 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52ea31-a9a5-4f4c-a6c4-8bf40148646a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:10.441758 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52ea31-a9a5-4f4c-a6c4-8bf40148646a None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:10.442049 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52ea31-a9a5-4f4c-a6c4-8bf40148646a None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:10.442334 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52ea31-a9a5-4f4c-a6c4-8bf40148646a None admin] PATH_INFO: `/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:10.443581 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad52ea31-a9a5-4f4c-a6c4-8bf40148646a None admin] RBAC: Authorizing `identity:get_project(project_id=8ac4a2d636fc4ebdb5fd8e84d1834c46)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:10.445065 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad52ea31-a9a5-4f4c-a6c4-8bf40148646a None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:10.446794 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 92/177] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:10 2022] GET /identity/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46 => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:10.453503 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52ea31-a9a5-4f4c-a6c4-8bf40148646a None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:10.566261 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdca8a-601b-459c-8434-3360bf567b53 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:10.626887 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e9685-1dd9-4ac9-af56-71fd51fbffc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:10.627582 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e9685-1dd9-4ac9-af56-71fd51fbffc7 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:10.627868 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e9685-1dd9-4ac9-af56-71fd51fbffc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:10.628147 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e9685-1dd9-4ac9-af56-71fd51fbffc7 None admin] PATH_INFO: `/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:10.629329 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e9685-1dd9-4ac9-af56-71fd51fbffc7 None admin] RBAC: Authorizing `identity:get_project(project_id=8ac4a2d636fc4ebdb5fd8e84d1834c46)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:10.630807 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e9685-1dd9-4ac9-af56-71fd51fbffc7 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:10.632711 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 86/178] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:10 2022] GET /identity/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:10.633724 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd20b44-29bb-4e9d-a3e2-c2d59cfe8a00 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:10.634008 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd20b44-29bb-4e9d-a3e2-c2d59cfe8a00 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:10.634551 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd20b44-29bb-4e9d-a3e2-c2d59cfe8a00 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:10.635538 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 87/179] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:10.641009 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd20b44-29bb-4e9d-a3e2-c2d59cfe8a00 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:10.700655 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:10.773605 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52ea31-a9a5-4f4c-a6c4-8bf40148646a None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:10.824357 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd20b44-29bb-4e9d-a3e2-c2d59cfe8a00 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:10.861582 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b471382-83fb-4177-87ca-0e0782fd26f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:10.863176 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b471382-83fb-4177-87ca-0e0782fd26f9 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:10.863698 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b471382-83fb-4177-87ca-0e0782fd26f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:10.864446 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b471382-83fb-4177-87ca-0e0782fd26f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:10.865878 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b471382-83fb-4177-87ca-0e0782fd26f9 None admin] RBAC: Adding query filter params (role.id=cdb6d97b8d4a41e8aaec05181b77fada, scope.project.id=8ac4a2d636fc4ebdb5fd8e84d1834c46, user.id=b4367dec09b843eeafd691b9d6214a78) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:10.866630 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b471382-83fb-4177-87ca-0e0782fd26f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:10.868585 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b471382-83fb-4177-87ca-0e0782fd26f9 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:10.875286 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f16205-e2f7-4be6-880d-d889ea1e79a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:10.875990 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f16205-e2f7-4be6-880d-d889ea1e79a0 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:10.876267 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f16205-e2f7-4be6-880d-d889ea1e79a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:10.876723 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 93/180] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 16:12:10 2022] GET /identity/v3/role_assignments?user.id=b4367dec09b843eeafd691b9d6214a78&scope.project.id=8ac4a2d636fc4ebdb5fd8e84d1834c46&role.id=cdb6d97b8d4a41e8aaec05181b77fada => generated 608 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:10.876830 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f16205-e2f7-4be6-880d-d889ea1e79a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:10.877339 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f16205-e2f7-4be6-880d-d889ea1e79a0 None admin] RBAC: Adding query filter params (role.id=76e01abae9964dd5b28fc8895f739ee4, scope.project.id=8ac4a2d636fc4ebdb5fd8e84d1834c46, user.id=30d80e0d318d4f78a4aac8c796957981) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:10.877654 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f16205-e2f7-4be6-880d-d889ea1e79a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:10.877752 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099d63e-7771-4a71-aab8-16337e99b5ca None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:10.878030 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099d63e-7771-4a71-aab8-16337e99b5ca None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:10.878309 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099d63e-7771-4a71-aab8-16337e99b5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:10.879134 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f16205-e2f7-4be6-880d-d889ea1e79a0 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:10.886718 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 88/181] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 16:12:10 2022] GET /identity/v3/role_assignments?user.id=30d80e0d318d4f78a4aac8c796957981&scope.project.id=8ac4a2d636fc4ebdb5fd8e84d1834c46&role.id=76e01abae9964dd5b28fc8895f739ee4 => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:10.896117 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b1e22-0ce5-4df0-ba60-0e5dd6c4d641 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:10.896471 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b1e22-0ce5-4df0-ba60-0e5dd6c4d641 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:10.896684 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b1e22-0ce5-4df0-ba60-0e5dd6c4d641 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:10.898611 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 89/182] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:10 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:10.900214 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f36fa1-f060-42b6-a471-ad53d60e1b5f None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:10.900325 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-3099d63e-7771-4a71-aab8-16337e99b5ca None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:10.900507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f36fa1-f060-42b6-a471-ad53d60e1b5f None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:10.900774 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f36fa1-f060-42b6-a471-ad53d60e1b5f None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:10.901486 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-3099d63e-7771-4a71-aab8-16337e99b5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:10.902417 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 90/183] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:10.908726 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089a6f1-c692-4eb9-ba3e-ff99e1bd9370 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:10.909047 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089a6f1-c692-4eb9-ba3e-ff99e1bd9370 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:10.909298 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089a6f1-c692-4eb9-ba3e-ff99e1bd9370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:10.948495 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-1089a6f1-c692-4eb9-ba3e-ff99e1bd9370 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:10.949755 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-1089a6f1-c692-4eb9-ba3e-ff99e1bd9370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:10.956109 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:11.045303 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 94/184] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:11.046669 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1142947-d63d-4443-b905-1d5ee655638f None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:11.046957 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1142947-d63d-4443-b905-1d5ee655638f None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:11.047233 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1142947-d63d-4443-b905-1d5ee655638f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:11.079965 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-f1142947-d63d-4443-b905-1d5ee655638f None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:11.081083 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-f1142947-d63d-4443-b905-1d5ee655638f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:11.112677 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 91/185] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:11.113883 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089a6f1-c692-4eb9-ba3e-ff99e1bd9370 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:11.133451 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:11.173310 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 95/186] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:11.174837 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23171c88-3b38-4616-a8b4-61008cbde286 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:11.175273 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23171c88-3b38-4616-a8b4-61008cbde286 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:11.175816 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23171c88-3b38-4616-a8b4-61008cbde286 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:11.177509 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 96/187] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:11.178459 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23171c88-3b38-4616-a8b4-61008cbde286 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:11.252690 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089a6f1-c692-4eb9-ba3e-ff99e1bd9370 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:11.286975 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93150d25-0685-4469-be13-5ff91d831b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:11.287659 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93150d25-0685-4469-be13-5ff91d831b7a None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:11.287943 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93150d25-0685-4469-be13-5ff91d831b7a None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:11.288219 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93150d25-0685-4469-be13-5ff91d831b7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:11.294554 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:11.299284 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93150d25-0685-4469-be13-5ff91d831b7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:11.300178 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23171c88-3b38-4616-a8b4-61008cbde286 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:11.304606 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-93150d25-0685-4469-be13-5ff91d831b7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:12:11.304606 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:11.304606 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:11.304606 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:11.304606 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:11.304606 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:11.304606 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:11.304606 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:11.304606 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:11.304606 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:11.304606 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:11.304606 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:11.304606 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:11.304606 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:11.304606 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:11.304606 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:11.305568 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:11.305568 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:11.305568 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:11.305568 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:11.305568 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:11.305568 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:11.305568 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:11.305568 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:11.305568 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:11.305568 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:11.305568 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:11.305568 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:11.305568 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:11.305568 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:11.305568 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:11.305568 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:11.311367 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:11.311367 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:11.311367 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:11.311367 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:11.311367 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:11.311367 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:11.311367 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:11.311367 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:11.311367 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:11.311367 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:11.311367 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:12:11.311367 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:12:11.311367 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 92/188] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 16:12:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:11.311367 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d76e0-d776-4ea3-afa7-1a21ca571312 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:11.312396 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d76e0-d776-4ea3-afa7-1a21ca571312 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:11.312396 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d76e0-d776-4ea3-afa7-1a21ca571312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:11.327617 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-816d76e0-d776-4ea3-afa7-1a21ca571312 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:11.328803 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-816d76e0-d776-4ea3-afa7-1a21ca571312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:11.335482 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16255878-d7d5-4981-ac33-3687ceaaf8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:11.336079 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16255878-d7d5-4981-ac33-3687ceaaf8c3 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:11.336363 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16255878-d7d5-4981-ac33-3687ceaaf8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:11.336640 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16255878-d7d5-4981-ac33-3687ceaaf8c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:11.347345 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16255878-d7d5-4981-ac33-3687ceaaf8c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:11.352384 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-16255878-d7d5-4981-ac33-3687ceaaf8c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:12:11.352384 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:11.352384 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:11.352384 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:11.352384 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:11.352384 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:11.352384 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:11.352384 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:11.352384 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:11.352384 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:11.352384 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:11.352384 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:11.352384 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:11.352384 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:11.352384 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:11.352384 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:11.353309 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:11.353309 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:11.353309 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:11.353309 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:11.353309 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:11.353309 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:11.353309 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:11.353309 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:11.353309 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:11.353309 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:11.353309 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:11.353309 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:11.353309 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:11.353309 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:11.353309 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:11.353309 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:11.354104 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:11.354104 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:11.354104 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:11.354104 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:11.354104 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:11.354104 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:11.354104 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:11.354104 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:11.354104 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:11.354104 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:11.354104 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:12:11.354104 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:11.354104 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 97/189] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 16:12:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:11.354764 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16255878-d7d5-4981-ac33-3687ceaaf8c3 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:11.404246 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 93/190] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:11.405122 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d76e0-d776-4ea3-afa7-1a21ca571312 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:11.408928 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:11.468853 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16255878-d7d5-4981-ac33-3687ceaaf8c3 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:11.503142 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aaff4f-a469-40de-92d7-5eb53a2cc040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:11.503822 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aaff4f-a469-40de-92d7-5eb53a2cc040 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:11.504106 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aaff4f-a469-40de-92d7-5eb53a2cc040 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:11.504388 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aaff4f-a469-40de-92d7-5eb53a2cc040 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:11.511911 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d76e0-d776-4ea3-afa7-1a21ca571312 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:11.514729 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aaff4f-a469-40de-92d7-5eb53a2cc040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:11.520170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-d1aaff4f-a469-40de-92d7-5eb53a2cc040 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:12:11.520170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:11.520170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:11.520170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:11.520170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:11.520170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:11.520170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:11.520170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:11.520170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:11.520170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:11.520170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:11.520170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:11.520170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:11.520170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:11.520170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:11.520170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:11.521064 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:11.521064 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:11.521064 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:11.521064 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:11.521064 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:11.521064 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:11.521064 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:11.521064 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:11.521064 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:11.521064 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:11.521064 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:11.521064 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:11.521064 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:11.521064 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:11.521064 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:11.521064 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:11.521850 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:11.521850 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:11.521850 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:11.521850 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:11.521850 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:11.521850 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:11.521850 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:11.521850 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:11.521850 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:11.521850 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:11.521850 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:12:11.521850 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:11.521850 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 98/191] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:11.522855 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aaff4f-a469-40de-92d7-5eb53a2cc040 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:11.549231 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:11.550672 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449560af-c404-4b8d-b97a-8356b9655d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:11.551402 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449560af-c404-4b8d-b97a-8356b9655d70 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:11.551770 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449560af-c404-4b8d-b97a-8356b9655d70 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:11.552049 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449560af-c404-4b8d-b97a-8356b9655d70 None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:11.552773 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449560af-c404-4b8d-b97a-8356b9655d70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:11.553079 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449560af-c404-4b8d-b97a-8356b9655d70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:11.554474 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449560af-c404-4b8d-b97a-8356b9655d70 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:11.563282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 94/192] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:11.568064 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449560af-c404-4b8d-b97a-8356b9655d70 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:11.636481 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aaff4f-a469-40de-92d7-5eb53a2cc040 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:11.638729 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:11.683687 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c20c3b-3912-4e4e-b37f-73f4f24b6b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:11.684326 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c20c3b-3912-4e4e-b37f-73f4f24b6b13 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:11.684653 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c20c3b-3912-4e4e-b37f-73f4f24b6b13 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:11.684936 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c20c3b-3912-4e4e-b37f-73f4f24b6b13 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:11.685666 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c20c3b-3912-4e4e-b37f-73f4f24b6b13 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:11.685975 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c20c3b-3912-4e4e-b37f-73f4f24b6b13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:11.687454 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c20c3b-3912-4e4e-b37f-73f4f24b6b13 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:11.688419 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449560af-c404-4b8d-b97a-8356b9655d70 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:11.696927 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 99/193] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:12:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:11.697828 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c20c3b-3912-4e4e-b37f-73f4f24b6b13 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:11.733257 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f318089-2873-4867-8fdd-451cdab372e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:11.734016 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f318089-2873-4867-8fdd-451cdab372e2 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:11.734296 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f318089-2873-4867-8fdd-451cdab372e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:11.734621 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f318089-2873-4867-8fdd-451cdab372e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:11.736374 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f318089-2873-4867-8fdd-451cdab372e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:11.738782 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f318089-2873-4867-8fdd-451cdab372e2 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:11.741495 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 95/194] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:12:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:11.742573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f318089-2873-4867-8fdd-451cdab372e2 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:11.792676 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:11.815466 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c20c3b-3912-4e4e-b37f-73f4f24b6b13 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:11.849265 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f318089-2873-4867-8fdd-451cdab372e2 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:11.853192 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85fb81-0675-4fb7-adde-91129c31af22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:11.853843 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85fb81-0675-4fb7-adde-91129c31af22 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:11.854129 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85fb81-0675-4fb7-adde-91129c31af22 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:11.854419 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85fb81-0675-4fb7-adde-91129c31af22 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:11.855152 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85fb81-0675-4fb7-adde-91129c31af22 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:11.855488 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85fb81-0675-4fb7-adde-91129c31af22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:11.856898 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85fb81-0675-4fb7-adde-91129c31af22 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:11.865833 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 100/195] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 16:12:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:11.865833 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85fb81-0675-4fb7-adde-91129c31af22 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:11.893727 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66083c91-819f-4303-8950-65d2ad057e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:11.894716 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66083c91-819f-4303-8950-65d2ad057e34 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:11.895207 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66083c91-819f-4303-8950-65d2ad057e34 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:11.895698 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66083c91-819f-4303-8950-65d2ad057e34 None admin] PATH_INFO: `/v3/users/466e88dbb96242d3979dc27951c56057` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:11.899072 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:11.920388 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66083c91-819f-4303-8950-65d2ad057e34 None admin] RBAC: Authorizing `identity:get_user(user_id=466e88dbb96242d3979dc27951c56057)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:11.921957 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66083c91-819f-4303-8950-65d2ad057e34 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:11.924143 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 96/196] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:12:11 2022] GET /identity/v3/users/466e88dbb96242d3979dc27951c56057 => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:11.924910 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66083c91-819f-4303-8950-65d2ad057e34 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:11.987509 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85fb81-0675-4fb7-adde-91129c31af22 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:12.022712 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef40e2-02b4-49f8-afe9-14683268c7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:12.023465 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef40e2-02b4-49f8-afe9-14683268c7d5 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:12.023761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef40e2-02b4-49f8-afe9-14683268c7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:12.024049 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef40e2-02b4-49f8-afe9-14683268c7d5 None admin] PATH_INFO: `/v3/users/466e88dbb96242d3979dc27951c56057` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:12.025268 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef40e2-02b4-49f8-afe9-14683268c7d5 None admin] RBAC: Authorizing `identity:get_user(user_id=466e88dbb96242d3979dc27951c56057)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:12.026730 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef40e2-02b4-49f8-afe9-14683268c7d5 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:12.028383 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 101/197] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:12:11 2022] GET /identity/v3/users/466e88dbb96242d3979dc27951c56057 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:12.029162 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef40e2-02b4-49f8-afe9-14683268c7d5 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:12.038305 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66083c91-819f-4303-8950-65d2ad057e34 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:12.044970 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:12.073619 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbb679-294f-4263-90f6-047a269a28ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:12.075134 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbb679-294f-4263-90f6-047a269a28ba None admin] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:12.075450 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbb679-294f-4263-90f6-047a269a28ba None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:12.075732 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbb679-294f-4263-90f6-047a269a28ba None admin] PATH_INFO: `/v3/users` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:12.076439 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbb679-294f-4263-90f6-047a269a28ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:12.078447 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbb679-294f-4263-90f6-047a269a28ba None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:12.099154 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 97/198] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 16:12:11 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:12:12.100108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbb679-294f-4263-90f6-047a269a28ba None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:12.148001 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef40e2-02b4-49f8-afe9-14683268c7d5 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:12.163276 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:12.193461 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944c46f-a97a-4705-a620-3280dd2bfb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:12.194486 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944c46f-a97a-4705-a620-3280dd2bfb97 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:12.195789 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944c46f-a97a-4705-a620-3280dd2bfb97 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:12.196110 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944c46f-a97a-4705-a620-3280dd2bfb97 None admin] PATH_INFO: `/v3/users/6944cc55ded644e7af8e7a198f3ba7dd` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:12.197581 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944c46f-a97a-4705-a620-3280dd2bfb97 None admin] RBAC: Authorizing `identity:get_user(user_id=6944cc55ded644e7af8e7a198f3ba7dd)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:12.199130 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944c46f-a97a-4705-a620-3280dd2bfb97 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:12.201164 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 102/199] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:12:12 2022] GET /identity/v3/users/6944cc55ded644e7af8e7a198f3ba7dd => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:12.201986 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944c46f-a97a-4705-a620-3280dd2bfb97 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:12.238019 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbb679-294f-4263-90f6-047a269a28ba None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:12.288020 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30adbed1-3709-4c8d-9653-e428da4ea722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:12.288672 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adbed1-3709-4c8d-9653-e428da4ea722 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:12.288956 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adbed1-3709-4c8d-9653-e428da4ea722 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:12.289237 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adbed1-3709-4c8d-9653-e428da4ea722 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:12.308250 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:12.334325 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944c46f-a97a-4705-a620-3280dd2bfb97 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:12.381264 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30adbed1-3709-4c8d-9653-e428da4ea722 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:12.381979 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e362afb-8c2a-424d-be55-ac6e4ea1bccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:12.382618 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e362afb-8c2a-424d-be55-ac6e4ea1bccc None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:12.382819 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30adbed1-3709-4c8d-9653-e428da4ea722 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:12.382915 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e362afb-8c2a-424d-be55-ac6e4ea1bccc None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:12.383168 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e362afb-8c2a-424d-be55-ac6e4ea1bccc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:12.453693 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:12.481418 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e362afb-8c2a-424d-be55-ac6e4ea1bccc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:12.482920 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e362afb-8c2a-424d-be55-ac6e4ea1bccc None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:12.538785 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 98/200] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:12:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:12:12.540466 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30adbed1-3709-4c8d-9653-e428da4ea722 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:12.615034 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:12.648957 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 103/201] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:12:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:12:12.654670 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e362afb-8c2a-424d-be55-ac6e4ea1bccc None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:12.697089 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30adbed1-3709-4c8d-9653-e428da4ea722 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:12.748352 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1996e1-de40-4ec4-a7c9-0ec72a42f05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:12.750192 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1996e1-de40-4ec4-a7c9-0ec72a42f05b None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:12.750663 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1996e1-de40-4ec4-a7c9-0ec72a42f05b None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:12.751119 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1996e1-de40-4ec4-a7c9-0ec72a42f05b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:12.774386 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:12.782767 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e362afb-8c2a-424d-be55-ac6e4ea1bccc None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:12.822944 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ca7a5-2b94-4888-95df-17c5eeb8b6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:12.823933 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ca7a5-2b94-4888-95df-17c5eeb8b6a4 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:12.824448 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ca7a5-2b94-4888-95df-17c5eeb8b6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:12.825018 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ca7a5-2b94-4888-95df-17c5eeb8b6a4 None admin] PATH_INFO: `/v3/projects/bcb322d69d74445d9641596caf1b6a8e` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:12.826410 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ca7a5-2b94-4888-95df-17c5eeb8b6a4 None admin] RBAC: Authorizing `identity:get_project(project_id=bcb322d69d74445d9641596caf1b6a8e)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:12.828191 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ca7a5-2b94-4888-95df-17c5eeb8b6a4 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:12.830374 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 104/202] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:12 2022] GET /identity/v3/projects/bcb322d69d74445d9641596caf1b6a8e => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:12.831445 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ca7a5-2b94-4888-95df-17c5eeb8b6a4 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:12.832703 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1996e1-de40-4ec4-a7c9-0ec72a42f05b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:12.834235 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1996e1-de40-4ec4-a7c9-0ec72a42f05b None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:12.896996 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:12.965934 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 99/203] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:12:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:12:12.967115 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1996e1-de40-4ec4-a7c9-0ec72a42f05b None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:12.970713 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ca7a5-2b94-4888-95df-17c5eeb8b6a4 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:13.014348 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9e714-c153-49a9-a0f4-032e6e716198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:13.015985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9e714-c153-49a9-a0f4-032e6e716198 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:13.016484 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9e714-c153-49a9-a0f4-032e6e716198 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:13.017056 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9e714-c153-49a9-a0f4-032e6e716198 None admin] PATH_INFO: `/v3/projects/bcb322d69d74445d9641596caf1b6a8e` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:13.018444 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9e714-c153-49a9-a0f4-032e6e716198 None admin] RBAC: Authorizing `identity:get_project(project_id=bcb322d69d74445d9641596caf1b6a8e)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:13.020307 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9e714-c153-49a9-a0f4-032e6e716198 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:13.022300 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 105/204] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:12 2022] GET /identity/v3/projects/bcb322d69d74445d9641596caf1b6a8e => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:13.023290 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9e714-c153-49a9-a0f4-032e6e716198 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:13.034287 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:13.092152 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1996e1-de40-4ec4-a7c9-0ec72a42f05b None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:13.131990 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f18e5-288d-4137-a63a-bf5184e22ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:13.132965 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f18e5-288d-4137-a63a-bf5184e22ec5 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:13.133466 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f18e5-288d-4137-a63a-bf5184e22ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:13.133927 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f18e5-288d-4137-a63a-bf5184e22ec5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:13.134910 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f18e5-288d-4137-a63a-bf5184e22ec5 None admin] RBAC: Adding query filter params (role.id=76e01abae9964dd5b28fc8895f739ee4, scope.project.id=bcb322d69d74445d9641596caf1b6a8e, user.id=466e88dbb96242d3979dc27951c56057) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:13.135447 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f18e5-288d-4137-a63a-bf5184e22ec5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:13.137081 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f18e5-288d-4137-a63a-bf5184e22ec5 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:13.144322 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 100/205] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 16:12:12 2022] GET /identity/v3/role_assignments?user.id=466e88dbb96242d3979dc27951c56057&scope.project.id=bcb322d69d74445d9641596caf1b6a8e&role.id=76e01abae9964dd5b28fc8895f739ee4 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:13.145513 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f18e5-288d-4137-a63a-bf5184e22ec5 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:13.147112 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9e714-c153-49a9-a0f4-032e6e716198 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:13.166451 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:13.201351 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba56263-447e-48c3-a3db-a7515989e1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:13.202032 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba56263-447e-48c3-a3db-a7515989e1b4 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:13.202387 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba56263-447e-48c3-a3db-a7515989e1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:13.202667 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba56263-447e-48c3-a3db-a7515989e1b4 None admin] PATH_INFO: `/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:13.203893 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba56263-447e-48c3-a3db-a7515989e1b4 None admin] RBAC: Authorizing `identity:get_project(project_id=8ac4a2d636fc4ebdb5fd8e84d1834c46)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:13.205365 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba56263-447e-48c3-a3db-a7515989e1b4 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:13.207268 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 106/206] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:13 2022] GET /identity/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:13.213491 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba56263-447e-48c3-a3db-a7515989e1b4 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:13.269253 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f18e5-288d-4137-a63a-bf5184e22ec5 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:13.286700 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:13.331042 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b82d7-8cd2-46a2-85be-41274ceefff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:13.331739 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b82d7-8cd2-46a2-85be-41274ceefff2 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:13.332042 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b82d7-8cd2-46a2-85be-41274ceefff2 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:13.332302 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b82d7-8cd2-46a2-85be-41274ceefff2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:13.333128 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b82d7-8cd2-46a2-85be-41274ceefff2 None admin] RBAC: Adding query filter params (role.id=cdb6d97b8d4a41e8aaec05181b77fada, scope.project.id=bcb322d69d74445d9641596caf1b6a8e, user.id=466e88dbb96242d3979dc27951c56057) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:13.333443 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b82d7-8cd2-46a2-85be-41274ceefff2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:13.334942 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b82d7-8cd2-46a2-85be-41274ceefff2 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:13.342704 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 101/207] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 16:12:13 2022] GET /identity/v3/role_assignments?user.id=466e88dbb96242d3979dc27951c56057&scope.project.id=bcb322d69d74445d9641596caf1b6a8e&role.id=cdb6d97b8d4a41e8aaec05181b77fada => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:13.433215 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba56263-447e-48c3-a3db-a7515989e1b4 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:13.482469 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e1d3b-15da-4a08-a8a9-0861a6a24909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:13.483133 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e1d3b-15da-4a08-a8a9-0861a6a24909 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:13.484019 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e1d3b-15da-4a08-a8a9-0861a6a24909 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:13.484312 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e1d3b-15da-4a08-a8a9-0861a6a24909 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:13.485190 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e1d3b-15da-4a08-a8a9-0861a6a24909 None admin] RBAC: Adding query filter params (role.id=b9b668e0b625469fa54fa2eb74cbdb97, scope.project.id=8ac4a2d636fc4ebdb5fd8e84d1834c46, user.id=6944cc55ded644e7af8e7a198f3ba7dd) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:13.485508 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e1d3b-15da-4a08-a8a9-0861a6a24909 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:13.487161 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e1d3b-15da-4a08-a8a9-0861a6a24909 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:13.494502 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 107/208] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 16:12:13 2022] GET /identity/v3/role_assignments?user.id=6944cc55ded644e7af8e7a198f3ba7dd&scope.project.id=8ac4a2d636fc4ebdb5fd8e84d1834c46&role.id=b9b668e0b625469fa54fa2eb74cbdb97 => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:14.703578 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db0386-4bfd-4fc2-b6c3-fa2aa634a8a3 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:14.704080 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db0386-4bfd-4fc2-b6c3-fa2aa634a8a3 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:14.704186 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db0386-4bfd-4fc2-b6c3-fa2aa634a8a3 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:14.705639 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 102/209] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:14.710205 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d529e8-59ec-4db5-b7b4-da452b973f23 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:14.710714 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d529e8-59ec-4db5-b7b4-da452b973f23 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:14.710787 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20d4f5-7004-4fd8-8839-3b1bd3d151b1 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:14.710856 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d529e8-59ec-4db5-b7b4-da452b973f23 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:14.711096 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20d4f5-7004-4fd8-8839-3b1bd3d151b1 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:14.711316 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20d4f5-7004-4fd8-8839-3b1bd3d151b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:14.712259 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 108/210] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:14.719000 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655f1b2-9522-48c9-9335-4c67bfe90815 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:14.719656 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655f1b2-9522-48c9-9335-4c67bfe90815 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:14.720166 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655f1b2-9522-48c9-9335-4c67bfe90815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:14.732518 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-1f20d4f5-7004-4fd8-8839-3b1bd3d151b1 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:14.734276 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-1f20d4f5-7004-4fd8-8839-3b1bd3d151b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:14.741089 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-d655f1b2-9522-48c9-9335-4c67bfe90815 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:14.742513 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-d655f1b2-9522-48c9-9335-4c67bfe90815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:14.791109 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:14.817515 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 109/211] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:12:14.824679 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 103/212] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:12:14.842802 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655f1b2-9522-48c9-9335-4c67bfe90815 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:14.852743 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20d4f5-7004-4fd8-8839-3b1bd3d151b1 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:14.959695 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655f1b2-9522-48c9-9335-4c67bfe90815 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:14.970808 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20d4f5-7004-4fd8-8839-3b1bd3d151b1 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:14.978423 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:14.996796 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f64ad2-2ea3-41ab-9928-02550c6c6c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:14.997771 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f64ad2-2ea3-41ab-9928-02550c6c6c69 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:14.998256 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f64ad2-2ea3-41ab-9928-02550c6c6c69 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:14.998756 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f64ad2-2ea3-41ab-9928-02550c6c6c69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:15.006216 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd9e8f-6f9a-4635-81b8-96037858c775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:15.006869 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd9e8f-6f9a-4635-81b8-96037858c775 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:15.007154 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd9e8f-6f9a-4635-81b8-96037858c775 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:15.007619 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd9e8f-6f9a-4635-81b8-96037858c775 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:15.008910 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd9e8f-6f9a-4635-81b8-96037858c775 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:15.010421 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd9e8f-6f9a-4635-81b8-96037858c775 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:15.011279 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f64ad2-2ea3-41ab-9928-02550c6c6c69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:15.012092 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 104/213] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:12:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:15.017926 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd9e8f-6f9a-4635-81b8-96037858c775 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:15.018170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-c3f64ad2-2ea3-41ab-9928-02550c6c6c69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:12:15.018170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:15.018170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:15.018170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:15.018170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:15.018170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:15.018170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:15.018170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:15.018170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:15.018170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:15.018170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:15.018170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:15.018170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:15.018170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:15.018170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:15.018170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:15.018999 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:15.018999 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:15.018999 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:15.018999 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:15.018999 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:15.018999 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:15.018999 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:15.018999 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:15.018999 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:15.018999 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:15.018999 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:15.018999 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:15.018999 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:15.018999 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:15.018999 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:15.018999 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:15.019817 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:15.019817 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:15.019817 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:15.019817 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:15.019817 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:15.019817 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:15.019817 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:15.019817 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:15.019817 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:15.019817 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:15.019817 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:12:15.019817 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:15.022106 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 110/214] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:15.028139 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f64ad2-2ea3-41ab-9928-02550c6c6c69 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:15.071971 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:15.121231 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd9e8f-6f9a-4635-81b8-96037858c775 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:15.142355 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f64ad2-2ea3-41ab-9928-02550c6c6c69 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:15.158230 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3bc230-f4fe-43d8-ab93-65ea6c0b6301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:15.159179 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bc230-f4fe-43d8-ab93-65ea6c0b6301 None admin] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:15.159179 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bc230-f4fe-43d8-ab93-65ea6c0b6301 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:15.159487 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bc230-f4fe-43d8-ab93-65ea6c0b6301 None admin] PATH_INFO: `/v3/users` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:15.160191 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3bc230-f4fe-43d8-ab93-65ea6c0b6301 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:15.161655 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3bc230-f4fe-43d8-ab93-65ea6c0b6301 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:15.184863 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155c525-30aa-4571-9dca-7489570f3332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:15.185956 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155c525-30aa-4571-9dca-7489570f3332 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:15.186485 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155c525-30aa-4571-9dca-7489570f3332 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:15.187628 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155c525-30aa-4571-9dca-7489570f3332 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:15.188610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155c525-30aa-4571-9dca-7489570f3332 None admin] RBAC: Adding query filter params (name=member) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:15.189117 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155c525-30aa-4571-9dca-7489570f3332 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:15.190932 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155c525-30aa-4571-9dca-7489570f3332 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:15.195603 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 105/215] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 16:12:15 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:12:15.205392 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 111/216] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 16:12:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:15.212074 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3bc230-f4fe-43d8-ab93-65ea6c0b6301 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:15.249890 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:15.336348 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3bc230-f4fe-43d8-ab93-65ea6c0b6301 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:15.376668 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da87f6-92f5-439b-a2e2-f1c691b6f0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:15.377360 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da87f6-92f5-439b-a2e2-f1c691b6f0f4 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:15.377629 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da87f6-92f5-439b-a2e2-f1c691b6f0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:15.377911 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da87f6-92f5-439b-a2e2-f1c691b6f0f4 None admin] PATH_INFO: `/v3/users/ce969f6492674fa58d463563c0ed18ad` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:15.393374 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da87f6-92f5-439b-a2e2-f1c691b6f0f4 None admin] RBAC: Authorizing `identity:get_user(user_id=ce969f6492674fa58d463563c0ed18ad)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:15.394871 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da87f6-92f5-439b-a2e2-f1c691b6f0f4 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:15.396628 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 106/217] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:12:15 2022] GET /identity/v3/users/ce969f6492674fa58d463563c0ed18ad => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:15.402648 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155c525-30aa-4571-9dca-7489570f3332 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:15.524095 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:15.529521 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155c525-30aa-4571-9dca-7489570f3332 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:15.569570 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f5f02-4278-4606-84a9-4ba244cc37cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:15.570205 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f5f02-4278-4606-84a9-4ba244cc37cd None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:15.570493 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f5f02-4278-4606-84a9-4ba244cc37cd None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:15.570773 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f5f02-4278-4606-84a9-4ba244cc37cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:15.645976 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f5f02-4278-4606-84a9-4ba244cc37cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:15.647469 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f5f02-4278-4606-84a9-4ba244cc37cd None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:15.704392 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c25c55-bf17-4723-9fb0-d84591911a3c None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:15.704897 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c25c55-bf17-4723-9fb0-d84591911a3c None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:15.704970 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c25c55-bf17-4723-9fb0-d84591911a3c None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:15.706472 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 107/218] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:15.717045 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050223f0-3627-4855-9f7d-e0320b088536 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:15.717352 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050223f0-3627-4855-9f7d-e0320b088536 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:15.717624 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050223f0-3627-4855-9f7d-e0320b088536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:15.760471 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-050223f0-3627-4855-9f7d-e0320b088536 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:15.761687 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-050223f0-3627-4855-9f7d-e0320b088536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:15.771247 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:15.775799 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 112/219] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:12:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:12:15.786594 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f5f02-4278-4606-84a9-4ba244cc37cd None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:15.900950 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 108/220] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:15.902131 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e46607-6d8f-4c62-a6b0-c6147794934a None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:15.902424 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e46607-6d8f-4c62-a6b0-c6147794934a None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:15.902703 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e46607-6d8f-4c62-a6b0-c6147794934a None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:15.904364 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 109/221] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:15.910382 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09d47a-990b-433f-98ba-3bef8f1cf471 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:15.910665 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09d47a-990b-433f-98ba-3bef8f1cf471 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:15.911139 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09d47a-990b-433f-98ba-3bef8f1cf471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:15.932982 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-ef09d47a-990b-433f-98ba-3bef8f1cf471 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:15.934181 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-ef09d47a-990b-433f-98ba-3bef8f1cf471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:15.950796 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:15.976942 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f5f02-4278-4606-84a9-4ba244cc37cd None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:16.013917 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfa72d-3bfa-4bff-8e50-61e034e851dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:16.014586 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfa72d-3bfa-4bff-8e50-61e034e851dc None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:16.014908 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfa72d-3bfa-4bff-8e50-61e034e851dc None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:16.015179 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfa72d-3bfa-4bff-8e50-61e034e851dc None admin] PATH_INFO: `/v3/projects/bcb322d69d74445d9641596caf1b6a8e` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:16.016407 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bfa72d-3bfa-4bff-8e50-61e034e851dc None admin] RBAC: Authorizing `identity:get_project(project_id=bcb322d69d74445d9641596caf1b6a8e)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:16.017930 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bfa72d-3bfa-4bff-8e50-61e034e851dc None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:16.019691 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 110/222] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:16.019959 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 113/223] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:15 2022] GET /identity/v3/projects/bcb322d69d74445d9641596caf1b6a8e => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:16.020809 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09d47a-990b-433f-98ba-3bef8f1cf471 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:16.025729 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfa72d-3bfa-4bff-8e50-61e034e851dc None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:16.098708 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:16.137398 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfa72d-3bfa-4bff-8e50-61e034e851dc None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:16.140392 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09d47a-990b-433f-98ba-3bef8f1cf471 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:16.176413 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a57271-9db2-4099-a0fd-a141de3f5544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:16.177204 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c4478-8ab3-41ea-b7b6-ec77aca1e50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:16.177333 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a57271-9db2-4099-a0fd-a141de3f5544 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:16.177678 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a57271-9db2-4099-a0fd-a141de3f5544 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:16.178051 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a57271-9db2-4099-a0fd-a141de3f5544 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:16.178391 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c4478-8ab3-41ea-b7b6-ec77aca1e50e None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:16.178809 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c4478-8ab3-41ea-b7b6-ec77aca1e50e None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:16.179233 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c4478-8ab3-41ea-b7b6-ec77aca1e50e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:16.180282 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c4478-8ab3-41ea-b7b6-ec77aca1e50e None admin] RBAC: Adding query filter params (role.id=5698bc4d332140e9af77ddcbb9915736, scope.project.id=bcb322d69d74445d9641596caf1b6a8e, user.id=ce969f6492674fa58d463563c0ed18ad) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:16.180749 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c4478-8ab3-41ea-b7b6-ec77aca1e50e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:16.182442 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c4478-8ab3-41ea-b7b6-ec77aca1e50e None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:16.190042 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a57271-9db2-4099-a0fd-a141de3f5544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:16.190459 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 114/224] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 16:12:16 2022] GET /identity/v3/role_assignments?user.id=ce969f6492674fa58d463563c0ed18ad&scope.project.id=bcb322d69d74445d9641596caf1b6a8e&role.id=5698bc4d332140e9af77ddcbb9915736 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:16.195647 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-99a57271-9db2-4099-a0fd-a141de3f5544 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:12:16.195647 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:16.195647 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:16.195647 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:16.195647 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:16.195647 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:16.195647 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:16.195647 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:16.195647 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:16.195647 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:16.195647 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:16.195647 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:16.195647 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:16.195647 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:16.195647 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:16.195647 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:16.197658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:16.197658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:16.197658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:16.197658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:16.197658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:16.197658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:16.197658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:16.197658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:16.197658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:16.197658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:16.197658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:16.197658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:16.197658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:16.197658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:16.197658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:16.197658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:16.199347 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:16.199347 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:16.199347 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:16.199347 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:16.199347 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:16.199347 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:16.199347 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:16.199347 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:16.199347 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:16.199347 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:16.199347 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:12:16.199347 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:12:16.200294 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 111/225] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 16:12:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:16.211531 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a57271-9db2-4099-a0fd-a141de3f5544 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:16.211730 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c4478-8ab3-41ea-b7b6-ec77aca1e50e None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:16.222969 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:16.336909 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c4478-8ab3-41ea-b7b6-ec77aca1e50e None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:16.372606 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:16.379676 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7ecdd-8b6d-453e-a24d-c1d7abf23684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:16.380434 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7ecdd-8b6d-453e-a24d-c1d7abf23684 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:16.380729 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7ecdd-8b6d-453e-a24d-c1d7abf23684 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:16.381010 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7ecdd-8b6d-453e-a24d-c1d7abf23684 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:16.381742 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7ecdd-8b6d-453e-a24d-c1d7abf23684 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:16.382053 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7ecdd-8b6d-453e-a24d-c1d7abf23684 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:16.383641 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7ecdd-8b6d-453e-a24d-c1d7abf23684 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:16.394039 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 115/226] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:16.399755 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7ecdd-8b6d-453e-a24d-c1d7abf23684 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:16.431646 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a57271-9db2-4099-a0fd-a141de3f5544 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:16.523422 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7ecdd-8b6d-453e-a24d-c1d7abf23684 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:16.572713 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee7904-bf60-4f50-a167-d73c0d23ca02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:16.573434 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee7904-bf60-4f50-a167-d73c0d23ca02 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:16.573724 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee7904-bf60-4f50-a167-d73c0d23ca02 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:16.574006 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee7904-bf60-4f50-a167-d73c0d23ca02 None admin] PATH_INFO: `/v3/users/466e88dbb96242d3979dc27951c56057` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:16.575202 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee7904-bf60-4f50-a167-d73c0d23ca02 None admin] RBAC: Authorizing `identity:get_user(user_id=466e88dbb96242d3979dc27951c56057)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:16.576697 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee7904-bf60-4f50-a167-d73c0d23ca02 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:16.579100 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 116/227] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:12:16 2022] GET /identity/v3/users/466e88dbb96242d3979dc27951c56057 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:16.584396 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee7904-bf60-4f50-a167-d73c0d23ca02 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:16.650681 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:16.694033 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee7904-bf60-4f50-a167-d73c0d23ca02 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:16.700101 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5d3a2-79d4-4071-9588-6489d1fbb3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:16.700775 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5d3a2-79d4-4071-9588-6489d1fbb3f6 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:16.701057 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5d3a2-79d4-4071-9588-6489d1fbb3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:16.701332 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5d3a2-79d4-4071-9588-6489d1fbb3f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:16.729666 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d010e1-6859-48d7-9c12-ed82f14b427c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:16.729978 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5d3a2-79d4-4071-9588-6489d1fbb3f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:16.730401 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d010e1-6859-48d7-9c12-ed82f14b427c None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:16.730591 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d010e1-6859-48d7-9c12-ed82f14b427c None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:16.730874 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d010e1-6859-48d7-9c12-ed82f14b427c None admin] PATH_INFO: `/v3/projects/bcb322d69d74445d9641596caf1b6a8e` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:16.732241 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d010e1-6859-48d7-9c12-ed82f14b427c None admin] RBAC: Authorizing `identity:get_project(project_id=bcb322d69d74445d9641596caf1b6a8e)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:16.734623 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d010e1-6859-48d7-9c12-ed82f14b427c None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:16.735932 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-24c5d3a2-79d4-4071-9588-6489d1fbb3f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:12:16.735932 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:16.735932 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:16.735932 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:16.735932 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:16.735932 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:16.735932 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:16.735932 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:16.735932 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:16.735932 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:16.735932 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:16.735932 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:16.735932 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:16.735932 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:16.735932 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:16.735932 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:16.736787 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:16.736787 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:16.736787 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:16.736787 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:16.736787 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:16.736787 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:16.736787 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:16.736787 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:16.736787 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:16.736787 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:16.736787 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:16.736787 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:16.736787 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:16.736787 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:16.736787 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:16.736787 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:16.737573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:16.737573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:16.737573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:16.737573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:16.737573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:16.737573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:16.737573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:16.737573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:16.737573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:16.737573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:16.737573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:12:16.737573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:12:16.737573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 112/228] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 16:12:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 537 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:16.738313 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 117/229] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:16 2022] GET /identity/v3/projects/bcb322d69d74445d9641596caf1b6a8e => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:16.742932 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5d3a2-79d4-4071-9588-6489d1fbb3f6 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:16.744196 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d010e1-6859-48d7-9c12-ed82f14b427c None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:16.892942 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d010e1-6859-48d7-9c12-ed82f14b427c None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:16.901240 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:16.928268 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:16.935651 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201007a-23c7-46e4-bf65-753964dec3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:16.936562 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201007a-23c7-46e4-bf65-753964dec3c2 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:16.936877 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201007a-23c7-46e4-bf65-753964dec3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:16.937160 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201007a-23c7-46e4-bf65-753964dec3c2 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:16.938143 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201007a-23c7-46e4-bf65-753964dec3c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:16.938845 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201007a-23c7-46e4-bf65-753964dec3c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:16.940310 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201007a-23c7-46e4-bf65-753964dec3c2 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:16.955226 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 118/230] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:12:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:16.964819 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201007a-23c7-46e4-bf65-753964dec3c2 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:16.977492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5d3a2-79d4-4071-9588-6489d1fbb3f6 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:17.057446 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e71824-819b-43e3-994b-70320de3612f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:17.058135 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e71824-819b-43e3-994b-70320de3612f None admin] REQUEST_METHOD: `PUT` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:17.058414 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e71824-819b-43e3-994b-70320de3612f None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:17.058685 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e71824-819b-43e3-994b-70320de3612f None admin] PATH_INFO: `/v3/projects/bcb322d69d74445d9641596caf1b6a8e/users/466e88dbb96242d3979dc27951c56057/roles/76e01abae9964dd5b28fc8895f739ee4` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:17.060728 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e71824-819b-43e3-994b-70320de3612f None admin] RBAC: Authorizing `identity:create_grant(project_id=bcb322d69d74445d9641596caf1b6a8e, user_id=466e88dbb96242d3979dc27951c56057, role_id=76e01abae9964dd5b28fc8895f739ee4)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:17.062270 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e71824-819b-43e3-994b-70320de3612f None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:17.081190 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 113/231] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 16:12:16 2022] PUT /identity/v3/projects/bcb322d69d74445d9641596caf1b6a8e/users/466e88dbb96242d3979dc27951c56057/roles/76e01abae9964dd5b28fc8895f739ee4 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:12:17.123838 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201007a-23c7-46e4-bf65-753964dec3c2 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:17.181932 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6fe46-77bd-43dc-b150-388af804e78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:17.182530 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6fe46-77bd-43dc-b150-388af804e78f None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:17.182818 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6fe46-77bd-43dc-b150-388af804e78f None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:17.183100 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6fe46-77bd-43dc-b150-388af804e78f None admin] PATH_INFO: `/v3/users/466e88dbb96242d3979dc27951c56057` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:17.188342 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de6fe46-77bd-43dc-b150-388af804e78f None admin] RBAC: Authorizing `identity:get_user(user_id=466e88dbb96242d3979dc27951c56057)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:17.189884 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de6fe46-77bd-43dc-b150-388af804e78f None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:17.191707 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 119/232] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:12:16 2022] GET /identity/v3/users/466e88dbb96242d3979dc27951c56057 => generated 283 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:17.197509 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e71824-819b-43e3-994b-70320de3612f None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:17.333933 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e71824-819b-43e3-994b-70320de3612f None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:17.361284 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:17.370687 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117398e8-68a0-4a3c-8209-5912bb50e9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:17.371394 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117398e8-68a0-4a3c-8209-5912bb50e9cf None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:17.371683 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117398e8-68a0-4a3c-8209-5912bb50e9cf None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:17.371960 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117398e8-68a0-4a3c-8209-5912bb50e9cf None admin] PATH_INFO: `/v3/projects/bcb322d69d74445d9641596caf1b6a8e` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:17.373385 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117398e8-68a0-4a3c-8209-5912bb50e9cf None admin] RBAC: Authorizing `identity:get_project(project_id=bcb322d69d74445d9641596caf1b6a8e)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:17.375859 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117398e8-68a0-4a3c-8209-5912bb50e9cf None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:17.377957 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 114/233] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:17 2022] GET /identity/v3/projects/bcb322d69d74445d9641596caf1b6a8e => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:17.383786 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6fe46-77bd-43dc-b150-388af804e78f None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:17.452822 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:17.509025 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6fe46-77bd-43dc-b150-388af804e78f None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:17.561061 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2fecb-558d-4740-92e1-2ce63a734a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:17.561790 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2fecb-558d-4740-92e1-2ce63a734a89 None admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:17.562125 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2fecb-558d-4740-92e1-2ce63a734a89 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:17.562407 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2fecb-558d-4740-92e1-2ce63a734a89 None admin] PATH_INFO: `/v3/projects/bcb322d69d74445d9641596caf1b6a8e/users/466e88dbb96242d3979dc27951c56057/roles/cdb6d97b8d4a41e8aaec05181b77fada` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:17.564685 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2fecb-558d-4740-92e1-2ce63a734a89 None admin] RBAC: Authorizing `identity:create_grant(project_id=bcb322d69d74445d9641596caf1b6a8e, user_id=466e88dbb96242d3979dc27951c56057, role_id=cdb6d97b8d4a41e8aaec05181b77fada)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:17.566144 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2fecb-558d-4740-92e1-2ce63a734a89 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:17.595542 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 120/234] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 16:12:17 2022] PUT /identity/v3/projects/bcb322d69d74445d9641596caf1b6a8e/users/466e88dbb96242d3979dc27951c56057/roles/cdb6d97b8d4a41e8aaec05181b77fada => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:12:18.157201 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3e265-6849-46f9-804d-e207f8a5075b None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:18.157721 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3e265-6849-46f9-804d-e207f8a5075b None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:18.157721 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3e265-6849-46f9-804d-e207f8a5075b None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:18.159447 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 115/235] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:18.164739 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4d58b-cdc7-43a8-ad25-baa47f4b4d50 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:18.165168 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4d58b-cdc7-43a8-ad25-baa47f4b4d50 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:18.165358 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4d58b-cdc7-43a8-ad25-baa47f4b4d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:18.189160 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-fde4d58b-cdc7-43a8-ad25-baa47f4b4d50 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:18.190327 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-fde4d58b-cdc7-43a8-ad25-baa47f4b4d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:18.281246 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd481a-3995-481c-89a3-8065e3799309 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:18.281695 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd481a-3995-481c-89a3-8065e3799309 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:18.281845 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd481a-3995-481c-89a3-8065e3799309 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:18.283169 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 116/236] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:12:18.288625 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c821de-cec8-4652-aca2-c714dc30603b None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:18.288921 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c821de-cec8-4652-aca2-c714dc30603b None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:18.289205 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c821de-cec8-4652-aca2-c714dc30603b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:18.294732 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 121/237] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:18.324391 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-a9c821de-cec8-4652-aca2-c714dc30603b None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:18.325604 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-a9c821de-cec8-4652-aca2-c714dc30603b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:18.346349 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4d58b-cdc7-43a8-ad25-baa47f4b4d50 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:18.436498 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:18.460500 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 117/238] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:12:18.491519 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c821de-cec8-4652-aca2-c714dc30603b None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:18.497214 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4d58b-cdc7-43a8-ad25-baa47f4b4d50 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:18.560344 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c251c3-caff-4ef9-9318-fdb1146eef41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:18.561353 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c251c3-caff-4ef9-9318-fdb1146eef41 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:18.562385 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c251c3-caff-4ef9-9318-fdb1146eef41 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:18.562860 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c251c3-caff-4ef9-9318-fdb1146eef41 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:18.574333 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c251c3-caff-4ef9-9318-fdb1146eef41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:18.579736 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-b8c251c3-caff-4ef9-9318-fdb1146eef41 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:12:18.579736 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:18.579736 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:18.579736 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:18.579736 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:18.579736 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:18.579736 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:18.579736 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:18.579736 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:18.579736 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:18.579736 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:18.579736 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:18.579736 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:18.579736 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:18.579736 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:18.579736 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:18.580589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:18.580589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:18.580589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:18.580589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:18.580589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:18.580589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:18.580589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:18.580589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:18.580589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:18.580589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:18.580589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:18.580589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:18.580589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:18.580589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:18.580589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:18.580589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:18.581366 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:18.581366 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:18.581366 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:18.581366 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:18.581366 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:18.581366 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:18.581366 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:18.581366 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:18.581366 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:18.581366 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:18.581366 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:12:18.581366 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:18.583713 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 122/239] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:12:18.593709 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c251c3-caff-4ef9-9318-fdb1146eef41 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:18.601683 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c821de-cec8-4652-aca2-c714dc30603b None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:18.648329 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:18.660647 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e769a5c-9c23-455a-b4b1-53c114d93b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:18.661314 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e769a5c-9c23-455a-b4b1-53c114d93b70 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:18.661602 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e769a5c-9c23-455a-b4b1-53c114d93b70 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:18.661882 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e769a5c-9c23-455a-b4b1-53c114d93b70 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:18.665531 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e769a5c-9c23-455a-b4b1-53c114d93b70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:18.672376 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e769a5c-9c23-455a-b4b1-53c114d93b70 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:18.675164 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 118/240] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:12:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:18.681836 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e769a5c-9c23-455a-b4b1-53c114d93b70 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:18.818217 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c251c3-caff-4ef9-9318-fdb1146eef41 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:18.852123 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:18.870752 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12475b32-3175-49a7-acc1-998c070ddd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:18.871406 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12475b32-3175-49a7-acc1-998c070ddd6a None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:18.871714 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12475b32-3175-49a7-acc1-998c070ddd6a None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:18.871996 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12475b32-3175-49a7-acc1-998c070ddd6a None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:18.872722 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12475b32-3175-49a7-acc1-998c070ddd6a None admin] RBAC: Adding query filter params (name=reader) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:18.873033 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12475b32-3175-49a7-acc1-998c070ddd6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:18.873811 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e769a5c-9c23-455a-b4b1-53c114d93b70 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:18.874952 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12475b32-3175-49a7-acc1-998c070ddd6a None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:18.885367 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 123/241] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 16:12:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:18.886762 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5e687-6e37-4a44-9aa0-2feb2677957d None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:18.887355 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5e687-6e37-4a44-9aa0-2feb2677957d None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:18.887685 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5e687-6e37-4a44-9aa0-2feb2677957d None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:18.889282 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 124/242] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:18.890541 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5e687-6e37-4a44-9aa0-2feb2677957d None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:18.922049 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795698a3-decc-4bc3-b4bb-7962a7e3a901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:18.923000 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795698a3-decc-4bc3-b4bb-7962a7e3a901 None admin] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:18.923294 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795698a3-decc-4bc3-b4bb-7962a7e3a901 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:18.923607 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795698a3-decc-4bc3-b4bb-7962a7e3a901 None admin] PATH_INFO: `/v3/users` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:18.924584 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795698a3-decc-4bc3-b4bb-7962a7e3a901 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:18.926213 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795698a3-decc-4bc3-b4bb-7962a7e3a901 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:18.953891 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 119/243] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 16:12:18 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:12:18.955620 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443459d-3140-4466-871b-d9dd0410f53f None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:18.955854 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443459d-3140-4466-871b-d9dd0410f53f None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:18.956085 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443459d-3140-4466-871b-d9dd0410f53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:18.980464 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-9443459d-3140-4466-871b-d9dd0410f53f None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:18.981764 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-9443459d-3140-4466-871b-d9dd0410f53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:19.016497 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5e687-6e37-4a44-9aa0-2feb2677957d None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:19.040968 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:19.069437 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc6c4b-1dee-48c6-ae64-8be4e60dc395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:19.071564 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc6c4b-1dee-48c6-ae64-8be4e60dc395 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:19.072419 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc6c4b-1dee-48c6-ae64-8be4e60dc395 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:19.074133 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc6c4b-1dee-48c6-ae64-8be4e60dc395 None admin] PATH_INFO: `/v3/users/80812ade5db44dfd981fb76cd8ae9526` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:19.082092 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 120/244] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:19.105866 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443459d-3140-4466-871b-d9dd0410f53f None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:19.107445 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc6c4b-1dee-48c6-ae64-8be4e60dc395 None admin] RBAC: Authorizing `identity:get_user(user_id=80812ade5db44dfd981fb76cd8ae9526)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:19.109165 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc6c4b-1dee-48c6-ae64-8be4e60dc395 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:19.111297 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 125/245] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:12:18 2022] GET /identity/v3/users/80812ade5db44dfd981fb76cd8ae9526 => generated 297 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:19.116446 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc6c4b-1dee-48c6-ae64-8be4e60dc395 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:19.160851 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:19.237355 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443459d-3140-4466-871b-d9dd0410f53f None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:19.271629 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc6c4b-1dee-48c6-ae64-8be4e60dc395 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:19.281556 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48320f94-e976-4a49-94a4-82d985ea7da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:19.282350 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48320f94-e976-4a49-94a4-82d985ea7da2 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:19.282734 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48320f94-e976-4a49-94a4-82d985ea7da2 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:19.283108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48320f94-e976-4a49-94a4-82d985ea7da2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:19.297823 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48320f94-e976-4a49-94a4-82d985ea7da2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:19.303345 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-48320f94-e976-4a49-94a4-82d985ea7da2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:12:19.303345 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:19.303345 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:19.303345 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:19.303345 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:19.303345 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:19.303345 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:19.303345 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:19.303345 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:19.303345 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:19.303345 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:19.303345 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:19.303345 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:19.303345 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:19.303345 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:19.303345 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:19.304502 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:19.304502 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:19.304502 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:19.304502 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:19.304502 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:19.304502 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:19.304502 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:19.304502 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:19.304502 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:19.304502 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:19.304502 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:19.304502 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:19.304502 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:19.304502 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:19.304502 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:19.304502 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:19.305570 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:19.305570 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:19.305570 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:19.305570 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:19.305570 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:19.305570 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:19.305570 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:19.305570 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:19.305570 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:19.305570 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:19.305570 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:12:19.305570 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:12:19.308342 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 121/246] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:19.313266 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48320f94-e976-4a49-94a4-82d985ea7da2 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:19.324061 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b9862-1061-4b63-a935-27394eba24dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:19.325057 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b9862-1061-4b63-a935-27394eba24dd None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:19.325519 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b9862-1061-4b63-a935-27394eba24dd None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:19.325971 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b9862-1061-4b63-a935-27394eba24dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:19.391012 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:19.438706 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b9862-1061-4b63-a935-27394eba24dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:19.440243 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b9862-1061-4b63-a935-27394eba24dd None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:19.456297 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48320f94-e976-4a49-94a4-82d985ea7da2 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:19.477075 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:19.510018 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a507b3-0d2d-4249-8f98-4d5f5a1ed08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:19.511083 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a507b3-0d2d-4249-8f98-4d5f5a1ed08e None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:19.511388 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a507b3-0d2d-4249-8f98-4d5f5a1ed08e None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:19.511678 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a507b3-0d2d-4249-8f98-4d5f5a1ed08e None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:19.512694 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a507b3-0d2d-4249-8f98-4d5f5a1ed08e None admin] RBAC: Adding query filter params (name=member) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:19.513117 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a507b3-0d2d-4249-8f98-4d5f5a1ed08e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:19.515158 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a507b3-0d2d-4249-8f98-4d5f5a1ed08e None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:19.527856 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 122/247] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 16:12:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:19.533795 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a507b3-0d2d-4249-8f98-4d5f5a1ed08e None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:19.583187 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 126/248] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:12:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 16:12:19.588956 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b9862-1061-4b63-a935-27394eba24dd None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:19.664090 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a507b3-0d2d-4249-8f98-4d5f5a1ed08e None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:19.666046 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:19.705683 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b9862-1061-4b63-a935-27394eba24dd None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:19.706591 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26f864-a111-48cb-8128-025121a76607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:19.707633 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26f864-a111-48cb-8128-025121a76607 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:19.708135 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26f864-a111-48cb-8128-025121a76607 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:19.708705 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26f864-a111-48cb-8128-025121a76607 None admin] PATH_INFO: `/v3/users/ce969f6492674fa58d463563c0ed18ad` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:19.710763 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26f864-a111-48cb-8128-025121a76607 None admin] RBAC: Authorizing `identity:get_user(user_id=ce969f6492674fa58d463563c0ed18ad)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:19.712813 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26f864-a111-48cb-8128-025121a76607 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:19.715114 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 123/249] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:12:19 2022] GET /identity/v3/users/ce969f6492674fa58d463563c0ed18ad => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:19.723055 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26f864-a111-48cb-8128-025121a76607 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:19.739057 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:19.746206 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246a1f3-13a1-44a7-ac8a-f68d97308a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:19.746862 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246a1f3-13a1-44a7-ac8a-f68d97308a6b None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:19.747145 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246a1f3-13a1-44a7-ac8a-f68d97308a6b None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:19.747567 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246a1f3-13a1-44a7-ac8a-f68d97308a6b None admin] PATH_INFO: `/v3/projects/bcb322d69d74445d9641596caf1b6a8e` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:19.748764 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3246a1f3-13a1-44a7-ac8a-f68d97308a6b None admin] RBAC: Authorizing `identity:get_project(project_id=bcb322d69d74445d9641596caf1b6a8e)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:19.750396 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3246a1f3-13a1-44a7-ac8a-f68d97308a6b None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:19.752547 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 127/250] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:19 2022] GET /identity/v3/projects/bcb322d69d74445d9641596caf1b6a8e => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:19.758718 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246a1f3-13a1-44a7-ac8a-f68d97308a6b None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:19.869291 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26f864-a111-48cb-8128-025121a76607 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:19.872923 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246a1f3-13a1-44a7-ac8a-f68d97308a6b None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:19.915568 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875598c5-948c-4748-8cd8-0f816c2393b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:19.916220 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875598c5-948c-4748-8cd8-0f816c2393b6 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:19.916510 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875598c5-948c-4748-8cd8-0f816c2393b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:19.916795 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875598c5-948c-4748-8cd8-0f816c2393b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:19.917611 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875598c5-948c-4748-8cd8-0f816c2393b6 None admin] RBAC: Adding query filter params (role.id=b9b668e0b625469fa54fa2eb74cbdb97, scope.project.id=bcb322d69d74445d9641596caf1b6a8e, user.id=80812ade5db44dfd981fb76cd8ae9526) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:19.917926 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875598c5-948c-4748-8cd8-0f816c2393b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:19.919428 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875598c5-948c-4748-8cd8-0f816c2393b6 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:19.920578 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c7f47-c693-4a61-933a-691856c183a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:19.921298 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c7f47-c693-4a61-933a-691856c183a4 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:19.921586 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c7f47-c693-4a61-933a-691856c183a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:19.921868 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c7f47-c693-4a61-933a-691856c183a4 None admin] PATH_INFO: `/v3/projects/bcb322d69d74445d9641596caf1b6a8e` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:19.923089 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c7f47-c693-4a61-933a-691856c183a4 None admin] RBAC: Authorizing `identity:get_project(project_id=bcb322d69d74445d9641596caf1b6a8e)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:19.924579 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c7f47-c693-4a61-933a-691856c183a4 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:19.926185 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 128/251] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 16:12:19 2022] GET /identity/v3/role_assignments?user.id=80812ade5db44dfd981fb76cd8ae9526&scope.project.id=bcb322d69d74445d9641596caf1b6a8e&role.id=b9b668e0b625469fa54fa2eb74cbdb97 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:19.926300 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 124/252] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:19 2022] GET /identity/v3/projects/bcb322d69d74445d9641596caf1b6a8e => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:19.937590 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875598c5-948c-4748-8cd8-0f816c2393b6 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:20.022983 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3403ce-57ff-49fa-9e07-1baded68f037 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:20.023325 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3403ce-57ff-49fa-9e07-1baded68f037 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:20.023598 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3403ce-57ff-49fa-9e07-1baded68f037 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:20.025145 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 125/253] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:20.030011 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:20.032961 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23e9cd-bbd2-49ef-8f33-87dc3e53845f None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:20.033232 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23e9cd-bbd2-49ef-8f33-87dc3e53845f None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:20.033466 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23e9cd-bbd2-49ef-8f33-87dc3e53845f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:20.068135 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-6b23e9cd-bbd2-49ef-8f33-87dc3e53845f None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:20.069586 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-6b23e9cd-bbd2-49ef-8f33-87dc3e53845f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:20.108456 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:20.121739 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875598c5-948c-4748-8cd8-0f816c2393b6 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:20.159210 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 126/254] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:20.202591 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23e9cd-bbd2-49ef-8f33-87dc3e53845f None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:20.205159 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe09b2-3d03-43e7-946a-c0820968dd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:20.205868 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe09b2-3d03-43e7-946a-c0820968dd0f None admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:20.206156 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe09b2-3d03-43e7-946a-c0820968dd0f None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:20.206432 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe09b2-3d03-43e7-946a-c0820968dd0f None admin] PATH_INFO: `/v3/projects/bcb322d69d74445d9641596caf1b6a8e/users/ce969f6492674fa58d463563c0ed18ad/roles/5698bc4d332140e9af77ddcbb9915736` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:20.208487 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe09b2-3d03-43e7-946a-c0820968dd0f None admin] RBAC: Authorizing `identity:create_grant(project_id=bcb322d69d74445d9641596caf1b6a8e, user_id=ce969f6492674fa58d463563c0ed18ad, role_id=5698bc4d332140e9af77ddcbb9915736)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:20.209979 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe09b2-3d03-43e7-946a-c0820968dd0f None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:20.242679 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 129/255] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 16:12:19 2022] PUT /identity/v3/projects/bcb322d69d74445d9641596caf1b6a8e/users/ce969f6492674fa58d463563c0ed18ad/roles/5698bc4d332140e9af77ddcbb9915736 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:12:20.356257 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23e9cd-bbd2-49ef-8f33-87dc3e53845f None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:20.396803 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36b948-b441-4520-a6fc-c3131b978623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:20.397373 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36b948-b441-4520-a6fc-c3131b978623 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:20.397660 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36b948-b441-4520-a6fc-c3131b978623 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:20.397937 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36b948-b441-4520-a6fc-c3131b978623 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:20.410800 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36b948-b441-4520-a6fc-c3131b978623 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:20.416341 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-0e36b948-b441-4520-a6fc-c3131b978623 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:12:20.416341 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:20.416341 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:20.416341 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:20.416341 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:20.416341 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:20.416341 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:20.416341 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:20.416341 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:20.416341 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:20.416341 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:20.416341 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:20.416341 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:20.416341 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:20.416341 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:20.416341 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:20.417343 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:20.417343 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:20.417343 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:20.417343 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:20.417343 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:20.417343 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:20.417343 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:20.417343 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:20.417343 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:20.417343 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:20.417343 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:20.417343 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:20.417343 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:20.417343 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:20.417343 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:20.417343 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:20.418159 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:20.418159 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:20.418159 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:20.418159 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:20.418159 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:20.418159 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:20.418159 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:20.418159 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:20.418159 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:20.418159 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:20.418159 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:12:20.418159 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:12:20.418159 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 127/256] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 16:12:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:20.426245 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe09b2-3d03-43e7-946a-c0820968dd0f None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:20.539923 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe09b2-3d03-43e7-946a-c0820968dd0f None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:20.567658 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:20.581141 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd2aeb-d8ac-4aed-8361-4337f69b3914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:20.581760 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd2aeb-d8ac-4aed-8361-4337f69b3914 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:20.582046 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd2aeb-d8ac-4aed-8361-4337f69b3914 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:20.582360 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd2aeb-d8ac-4aed-8361-4337f69b3914 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:20.583105 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd2aeb-d8ac-4aed-8361-4337f69b3914 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:20.587919 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd2aeb-d8ac-4aed-8361-4337f69b3914 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:20.589384 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd2aeb-d8ac-4aed-8361-4337f69b3914 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:20.599180 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 130/257] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:20.605206 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36b948-b441-4520-a6fc-c3131b978623 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:20.641691 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:20.697970 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83501abe-6ea6-4860-9f47-6183d98bc88e None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:20.698349 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83501abe-6ea6-4860-9f47-6183d98bc88e None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:20.698571 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83501abe-6ea6-4860-9f47-6183d98bc88e None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:20.700286 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 131/258] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:12:20.709353 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d075d6a-ed7d-4e58-9e95-af2aff200d32 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:20.709532 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d075d6a-ed7d-4e58-9e95-af2aff200d32 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:20.709991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d075d6a-ed7d-4e58-9e95-af2aff200d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:20.732005 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-8d075d6a-ed7d-4e58-9e95-af2aff200d32 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:20.734128 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-8d075d6a-ed7d-4e58-9e95-af2aff200d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:20.744976 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36b948-b441-4520-a6fc-c3131b978623 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:20.781775 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6823db-5121-406c-863b-7541412f5ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:20.782695 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6823db-5121-406c-863b-7541412f5ffc None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:20.783120 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6823db-5121-406c-863b-7541412f5ffc None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:20.783581 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6823db-5121-406c-863b-7541412f5ffc None admin] PATH_INFO: `/v3/users/466e88dbb96242d3979dc27951c56057` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:20.784949 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6823db-5121-406c-863b-7541412f5ffc None admin] RBAC: Authorizing `identity:get_user(user_id=466e88dbb96242d3979dc27951c56057)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:20.786529 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6823db-5121-406c-863b-7541412f5ffc None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:20.788877 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 128/259] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:12:20 2022] GET /identity/v3/users/466e88dbb96242d3979dc27951c56057 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:20.794470 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6823db-5121-406c-863b-7541412f5ffc None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:20.819521 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 132/260] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:12:20.843544 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d075d6a-ed7d-4e58-9e95-af2aff200d32 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:20.899568 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:20.906064 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6823db-5121-406c-863b-7541412f5ffc None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:20.945422 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d030a5-9169-400d-b12e-a600b466a61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:20.946277 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d030a5-9169-400d-b12e-a600b466a61d None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:20.946826 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d030a5-9169-400d-b12e-a600b466a61d None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:20.947244 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d030a5-9169-400d-b12e-a600b466a61d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:20.958924 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d075d6a-ed7d-4e58-9e95-af2aff200d32 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:20.975023 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:21.004999 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a1fc6-6217-4e66-8cb3-dc8bcdf5daab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:21.006046 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a1fc6-6217-4e66-8cb3-dc8bcdf5daab None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:21.006684 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a1fc6-6217-4e66-8cb3-dc8bcdf5daab None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:21.007104 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a1fc6-6217-4e66-8cb3-dc8bcdf5daab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:21.023127 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a1fc6-6217-4e66-8cb3-dc8bcdf5daab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:21.028885 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d030a5-9169-400d-b12e-a600b466a61d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:21.029727 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-988a1fc6-6217-4e66-8cb3-dc8bcdf5daab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:12:21.029727 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:21.029727 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:21.029727 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:21.029727 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:21.029727 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:21.029727 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:21.029727 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:21.029727 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:21.029727 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:21.029727 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:21.029727 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:21.029727 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:21.029727 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:21.029727 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:21.029727 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:21.031336 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:21.031336 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:21.031336 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:21.031336 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:21.031336 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:21.031336 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:21.031336 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:21.031336 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:21.031336 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:21.031336 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:21.031336 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:21.031336 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:21.031336 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:21.031336 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:21.031336 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:21.031336 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:21.032349 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:21.032349 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:21.032349 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:21.032349 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:21.032349 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:21.032349 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:21.032349 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:21.032349 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:21.032349 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:21.032349 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:21.032349 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:12:21.032349 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:21.033652 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d030a5-9169-400d-b12e-a600b466a61d None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:21.034782 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 133/261] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 16:12:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:12:21.045442 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a1fc6-6217-4e66-8cb3-dc8bcdf5daab None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:21.167260 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a1fc6-6217-4e66-8cb3-dc8bcdf5daab None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:21.214571 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b4d8e-fe9d-4ee9-9bfb-d6f2b3343c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:21.215503 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b4d8e-fe9d-4ee9-9bfb-d6f2b3343c06 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:21.215964 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b4d8e-fe9d-4ee9-9bfb-d6f2b3343c06 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:21.216413 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b4d8e-fe9d-4ee9-9bfb-d6f2b3343c06 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:21.217306 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b4d8e-fe9d-4ee9-9bfb-d6f2b3343c06 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:21.219466 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b4d8e-fe9d-4ee9-9bfb-d6f2b3343c06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:21.221050 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b4d8e-fe9d-4ee9-9bfb-d6f2b3343c06 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:21.233233 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:21.238788 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 134/262] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:12:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:21.243200 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 129/263] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:12:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:12:21.248702 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b4d8e-fe9d-4ee9-9bfb-d6f2b3343c06 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:21.250858 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d030a5-9169-400d-b12e-a600b466a61d None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:21.321132 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:21.452490 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b4d8e-fe9d-4ee9-9bfb-d6f2b3343c06 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:21.470542 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d030a5-9169-400d-b12e-a600b466a61d None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:21.528640 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb50e8-2958-47de-9ef4-81d8ff51e47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:21.530934 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb50e8-2958-47de-9ef4-81d8ff51e47c None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:21.531362 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb50e8-2958-47de-9ef4-81d8ff51e47c None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:21.532741 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb50e8-2958-47de-9ef4-81d8ff51e47c None admin] PATH_INFO: `/v3/users/466e88dbb96242d3979dc27951c56057` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:21.534732 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb50e8-2958-47de-9ef4-81d8ff51e47c None admin] RBAC: Authorizing `identity:get_user(user_id=466e88dbb96242d3979dc27951c56057)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:21.537086 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb50e8-2958-47de-9ef4-81d8ff51e47c None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:21.540755 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 135/264] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:12:21 2022] GET /identity/v3/users/466e88dbb96242d3979dc27951c56057 => generated 283 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:21.548097 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64605d-431c-4de2-849d-05a0ffdebe54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:21.548960 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64605d-431c-4de2-849d-05a0ffdebe54 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:21.549966 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb50e8-2958-47de-9ef4-81d8ff51e47c None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:21.550417 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64605d-431c-4de2-849d-05a0ffdebe54 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:21.551006 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64605d-431c-4de2-849d-05a0ffdebe54 None admin] PATH_INFO: `/v3/projects/bcb322d69d74445d9641596caf1b6a8e` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:21.555089 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64605d-431c-4de2-849d-05a0ffdebe54 None admin] RBAC: Authorizing `identity:get_project(project_id=bcb322d69d74445d9641596caf1b6a8e)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:21.556732 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64605d-431c-4de2-849d-05a0ffdebe54 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:21.561577 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 130/265] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:21 2022] GET /identity/v3/projects/bcb322d69d74445d9641596caf1b6a8e => generated 302 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:21.568309 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64605d-431c-4de2-849d-05a0ffdebe54 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:21.643944 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:21.740884 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64605d-431c-4de2-849d-05a0ffdebe54 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:21.777554 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb50e8-2958-47de-9ef4-81d8ff51e47c None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:21.783741 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:21.819756 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af221c27-65cd-4793-90a5-d019e0ef7169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:21.820391 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af221c27-65cd-4793-90a5-d019e0ef7169 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:21.820678 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af221c27-65cd-4793-90a5-d019e0ef7169 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:21.820959 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af221c27-65cd-4793-90a5-d019e0ef7169 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:21.821750 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af221c27-65cd-4793-90a5-d019e0ef7169 None admin] RBAC: Adding query filter params (role.id=76e01abae9964dd5b28fc8895f739ee4, scope.project.id=bcb322d69d74445d9641596caf1b6a8e, user.id=466e88dbb96242d3979dc27951c56057) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:21.822065 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af221c27-65cd-4793-90a5-d019e0ef7169 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:21.823535 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af221c27-65cd-4793-90a5-d019e0ef7169 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:21.836730 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 131/266] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 16:12:21 2022] GET /identity/v3/role_assignments?user.id=466e88dbb96242d3979dc27951c56057&scope.project.id=bcb322d69d74445d9641596caf1b6a8e&role.id=76e01abae9964dd5b28fc8895f739ee4 => generated 608 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:21.850051 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66f5bf-52ab-48b6-969a-f7263627aa7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:21.850705 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66f5bf-52ab-48b6-969a-f7263627aa7a None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:21.851086 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66f5bf-52ab-48b6-969a-f7263627aa7a None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:21.851405 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66f5bf-52ab-48b6-969a-f7263627aa7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:21.951622 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66f5bf-52ab-48b6-969a-f7263627aa7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:21.953203 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66f5bf-52ab-48b6-969a-f7263627aa7a None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:22.074606 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 136/267] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:12:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:12:22.081148 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af221c27-65cd-4793-90a5-d019e0ef7169 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:22.193001 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af221c27-65cd-4793-90a5-d019e0ef7169 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:22.221895 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:22.231941 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f518b-3676-4e91-86a4-5d26051e2bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:22.232608 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f518b-3676-4e91-86a4-5d26051e2bf3 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:22.232898 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f518b-3676-4e91-86a4-5d26051e2bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:22.233181 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f518b-3676-4e91-86a4-5d26051e2bf3 None admin] PATH_INFO: `/v3/projects/bcb322d69d74445d9641596caf1b6a8e` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:22.234491 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f518b-3676-4e91-86a4-5d26051e2bf3 None admin] RBAC: Authorizing `identity:get_project(project_id=bcb322d69d74445d9641596caf1b6a8e)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:22.236032 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f518b-3676-4e91-86a4-5d26051e2bf3 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:22.237715 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 132/268] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:22 2022] GET /identity/v3/projects/bcb322d69d74445d9641596caf1b6a8e => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:22.243787 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66f5bf-52ab-48b6-969a-f7263627aa7a None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:22.247803 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:22.356506 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66f5bf-52ab-48b6-969a-f7263627aa7a None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:22.395426 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46309dcd-465d-495c-bb9b-be63d9a86cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:22.396063 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46309dcd-465d-495c-bb9b-be63d9a86cf5 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:22.396348 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46309dcd-465d-495c-bb9b-be63d9a86cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:22.396629 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46309dcd-465d-495c-bb9b-be63d9a86cf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:22.397437 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46309dcd-465d-495c-bb9b-be63d9a86cf5 None admin] RBAC: Adding query filter params (role.id=cdb6d97b8d4a41e8aaec05181b77fada, scope.project.id=bcb322d69d74445d9641596caf1b6a8e, user.id=466e88dbb96242d3979dc27951c56057) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:22.397748 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46309dcd-465d-495c-bb9b-be63d9a86cf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:22.399230 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46309dcd-465d-495c-bb9b-be63d9a86cf5 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:22.408774 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 137/269] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 16:12:22 2022] GET /identity/v3/role_assignments?user.id=466e88dbb96242d3979dc27951c56057&scope.project.id=bcb322d69d74445d9641596caf1b6a8e&role.id=cdb6d97b8d4a41e8aaec05181b77fada => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:23.070563 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c94b12-3c95-4217-a943-9d29a68cbf9d None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:23.071079 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c94b12-3c95-4217-a943-9d29a68cbf9d None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:23.071154 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c94b12-3c95-4217-a943-9d29a68cbf9d None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:23.072786 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 133/270] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:23.079007 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd80606-1b75-4ed1-b316-14ea657a4ae7 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:23.079484 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd80606-1b75-4ed1-b316-14ea657a4ae7 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:23.079684 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd80606-1b75-4ed1-b316-14ea657a4ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:23.102666 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-3dd80606-1b75-4ed1-b316-14ea657a4ae7 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:23.103927 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-3dd80606-1b75-4ed1-b316-14ea657a4ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:23.113900 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83746566-026a-48aa-9d6c-6cc55a785b4d None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:23.114904 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83746566-026a-48aa-9d6c-6cc55a785b4d None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:23.114904 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83746566-026a-48aa-9d6c-6cc55a785b4d None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:23.115930 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 134/271] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:12:23.124444 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcccb9e-736d-4674-aed6-fee343ff327f None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:23.124731 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcccb9e-736d-4674-aed6-fee343ff327f None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:23.125007 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcccb9e-736d-4674-aed6-fee343ff327f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:23.151339 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-1fcccb9e-736d-4674-aed6-fee343ff327f None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:23.152577 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-1fcccb9e-736d-4674-aed6-fee343ff327f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:23.187220 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:23.191314 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 138/272] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:12:23.221073 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd80606-1b75-4ed1-b316-14ea657a4ae7 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:23.239444 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 135/273] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:12:23.266579 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcccb9e-736d-4674-aed6-fee343ff327f None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:23.332153 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd80606-1b75-4ed1-b316-14ea657a4ae7 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:23.370774 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcccb9e-736d-4674-aed6-fee343ff327f None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:23.371795 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fd4e9-497d-4860-b514-fd0406fa990a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:23.372582 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fd4e9-497d-4860-b514-fd0406fa990a None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:23.372867 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fd4e9-497d-4860-b514-fd0406fa990a None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:23.373259 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fd4e9-497d-4860-b514-fd0406fa990a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:23.385298 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07fd4e9-497d-4860-b514-fd0406fa990a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:23.391302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-b07fd4e9-497d-4860-b514-fd0406fa990a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:12:23.391302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:23.391302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:23.391302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:23.391302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:23.391302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:23.391302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:23.391302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:23.391302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:23.391302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:23.391302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:23.391302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:23.391302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:23.391302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:23.391302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:23.391302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:23.392272 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:23.392272 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:23.392272 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:23.392272 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:23.392272 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:23.392272 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:23.392272 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:23.392272 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:23.392272 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:23.392272 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:23.392272 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:23.392272 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:23.392272 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:23.392272 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:23.392272 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:23.392272 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:23.393062 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:23.393062 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:23.393062 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:23.393062 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:23.393062 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:23.393062 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:23.393062 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:23.393062 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:23.393062 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:23.393062 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:23.393062 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:12:23.393062 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:23.393062 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 139/274] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:12:23.393691 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c93f69-78cf-48a3-bc5f-3157ceb42f5c None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:23.394213 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c93f69-78cf-48a3-bc5f-3157ceb42f5c None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:23.394213 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c93f69-78cf-48a3-bc5f-3157ceb42f5c None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:23.395573 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 140/275] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:23.400118 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c93f69-78cf-48a3-bc5f-3157ceb42f5c None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:23.402905 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:23.414330 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb2a9c-2168-4db6-91d6-214b0d79fda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:23.414986 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb2a9c-2168-4db6-91d6-214b0d79fda0 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:23.415270 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb2a9c-2168-4db6-91d6-214b0d79fda0 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:23.415587 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb2a9c-2168-4db6-91d6-214b0d79fda0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:23.416743 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb2a9c-2168-4db6-91d6-214b0d79fda0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:23.419211 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb2a9c-2168-4db6-91d6-214b0d79fda0 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:23.420019 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 136/276] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:12:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:23.424671 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b580a-6c53-4c99-b1ab-827d6d36760e None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:23.425487 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b580a-6c53-4c99-b1ab-827d6d36760e None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:23.425768 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b580a-6c53-4c99-b1ab-827d6d36760e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:23.446038 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-a83b580a-6c53-4c99-b1ab-827d6d36760e None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:23.447655 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-a83b580a-6c53-4c99-b1ab-827d6d36760e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:23.471833 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:23.522179 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c93f69-78cf-48a3-bc5f-3157ceb42f5c None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:23.525232 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 137/277] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:23.528277 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b580a-6c53-4c99-b1ab-827d6d36760e None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:23.639328 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b580a-6c53-4c99-b1ab-827d6d36760e None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:23.677712 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:23.679031 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e5335-d9e2-4365-8a6a-e90449356842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:23.680085 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e5335-d9e2-4365-8a6a-e90449356842 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:23.680415 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e5335-d9e2-4365-8a6a-e90449356842 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:23.680846 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e5335-d9e2-4365-8a6a-e90449356842 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:23.681428 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573b656-d1f6-46e8-8890-bfd655ea563c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:23.681548 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e5335-d9e2-4365-8a6a-e90449356842 None admin] RBAC: Adding query filter params (name=member) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:23.681817 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e5335-d9e2-4365-8a6a-e90449356842 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:23.682569 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573b656-d1f6-46e8-8890-bfd655ea563c None admin] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:23.683113 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573b656-d1f6-46e8-8890-bfd655ea563c None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:23.683217 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e5335-d9e2-4365-8a6a-e90449356842 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:23.683654 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573b656-d1f6-46e8-8890-bfd655ea563c None admin] PATH_INFO: `/v3/users` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:23.684359 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4573b656-d1f6-46e8-8890-bfd655ea563c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:23.685813 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4573b656-d1f6-46e8-8890-bfd655ea563c None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:23.691921 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 141/278] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 16:12:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:23.693125 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b402b-fd70-4af9-b177-7351d3ba7151 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:23.693411 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b402b-fd70-4af9-b177-7351d3ba7151 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:23.693688 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b402b-fd70-4af9-b177-7351d3ba7151 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:23.695030 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 142/279] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:23.696973 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b402b-fd70-4af9-b177-7351d3ba7151 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:23.715533 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 138/280] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 16:12:23 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:12:23.716367 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573b656-d1f6-46e8-8890-bfd655ea563c None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:23.831225 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b402b-fd70-4af9-b177-7351d3ba7151 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:23.844266 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573b656-d1f6-46e8-8890-bfd655ea563c None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:23.857164 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:23.874542 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9096db0-0b2b-4017-851c-0be26bc2b8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:23.875239 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9096db0-0b2b-4017-851c-0be26bc2b8e1 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:23.875514 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9096db0-0b2b-4017-851c-0be26bc2b8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:23.875787 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9096db0-0b2b-4017-851c-0be26bc2b8e1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:23.881235 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79f9c9-ab0e-4e5a-acc6-b806d075538d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:23.881917 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79f9c9-ab0e-4e5a-acc6-b806d075538d None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:23.882198 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79f9c9-ab0e-4e5a-acc6-b806d075538d None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:23.882476 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79f9c9-ab0e-4e5a-acc6-b806d075538d None admin] PATH_INFO: `/v3/users/c02f8557e76c4e7cbfb100dbad153ad5` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:23.888746 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9096db0-0b2b-4017-851c-0be26bc2b8e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:23.894328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-b9096db0-0b2b-4017-851c-0be26bc2b8e1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:12:23.894328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:23.894328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:23.894328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:23.894328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:23.894328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:23.894328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:23.894328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:23.894328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:23.894328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:23.894328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:23.894328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:23.894328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:23.894328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:23.894328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:23.894328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:23.895206 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:23.895206 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:23.895206 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:23.895206 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:23.895206 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:23.895206 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:23.895206 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:23.895206 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:23.895206 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:23.895206 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:23.895206 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:23.895206 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:23.895206 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:23.895206 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:23.895206 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:23.895206 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:23.896044 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:23.896044 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:23.896044 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:23.896044 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:23.896044 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:23.896044 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:23.896044 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:23.896044 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:23.896044 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:23.896044 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:23.896044 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:12:23.896044 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:23.896044 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 143/281] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:23.896709 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea91bd-c7a6-4bad-96a2-1ad329cae136 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:23.897141 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea91bd-c7a6-4bad-96a2-1ad329cae136 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:23.897240 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea91bd-c7a6-4bad-96a2-1ad329cae136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:23.902059 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d79f9c9-ab0e-4e5a-acc6-b806d075538d None admin] RBAC: Authorizing `identity:get_user(user_id=c02f8557e76c4e7cbfb100dbad153ad5)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:23.902059 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d79f9c9-ab0e-4e5a-acc6-b806d075538d None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:23.902443 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 139/282] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:12:23 2022] GET /identity/v3/users/c02f8557e76c4e7cbfb100dbad153ad5 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:23.909294 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79f9c9-ab0e-4e5a-acc6-b806d075538d None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:23.918172 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-31ea91bd-c7a6-4bad-96a2-1ad329cae136 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:23.920150 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-31ea91bd-c7a6-4bad-96a2-1ad329cae136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:23.962262 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:23.994743 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 144/283] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:23.996084 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea91bd-c7a6-4bad-96a2-1ad329cae136 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:24.057563 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79f9c9-ab0e-4e5a-acc6-b806d075538d None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:24.103228 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf868e4f-1ce5-4036-887c-63805c5bc8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:24.103907 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf868e4f-1ce5-4036-887c-63805c5bc8ba None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:24.104153 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf868e4f-1ce5-4036-887c-63805c5bc8ba None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:24.104428 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf868e4f-1ce5-4036-887c-63805c5bc8ba None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:24.105145 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf868e4f-1ce5-4036-887c-63805c5bc8ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:24.105447 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf868e4f-1ce5-4036-887c-63805c5bc8ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:24.106956 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf868e4f-1ce5-4036-887c-63805c5bc8ba None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:24.116319 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 140/284] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 16:12:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:24.117269 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf868e4f-1ce5-4036-887c-63805c5bc8ba None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:24.137918 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea91bd-c7a6-4bad-96a2-1ad329cae136 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:24.153887 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:24.189172 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a4939-19fb-419c-a043-5f3aef6b81c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:24.189898 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a4939-19fb-419c-a043-5f3aef6b81c4 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:24.190233 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a4939-19fb-419c-a043-5f3aef6b81c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:24.190572 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a4939-19fb-419c-a043-5f3aef6b81c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:24.191739 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a4939-19fb-419c-a043-5f3aef6b81c4 None admin] RBAC: Adding query filter params (role.id=5698bc4d332140e9af77ddcbb9915736, user.id=c02f8557e76c4e7cbfb100dbad153ad5, scope.system=all) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:24.192683 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a4939-19fb-419c-a043-5f3aef6b81c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:24.194495 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a4939-19fb-419c-a043-5f3aef6b81c4 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:24.201442 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 145/285] 10.222.0.65 () {56 vars in 1308 bytes} [Wed Jul 27 16:12:23 2022] GET /identity/v3/role_assignments?user.id=c02f8557e76c4e7cbfb100dbad153ad5&scope.system=all&role.id=5698bc4d332140e9af77ddcbb9915736 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:24.203476 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a4939-19fb-419c-a043-5f3aef6b81c4 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:24.231312 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:24.236065 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf868e4f-1ce5-4036-887c-63805c5bc8ba None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:24.276173 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32221f0-4181-4465-8a45-5795be5c3ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:24.276838 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32221f0-4181-4465-8a45-5795be5c3ce6 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:24.277121 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32221f0-4181-4465-8a45-5795be5c3ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:24.277395 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32221f0-4181-4465-8a45-5795be5c3ce6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:24.290717 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32221f0-4181-4465-8a45-5795be5c3ce6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:24.296080 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-f32221f0-4181-4465-8a45-5795be5c3ce6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:12:24.296080 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:24.296080 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:24.296080 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:24.296080 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:24.296080 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:24.296080 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:24.296080 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:24.296080 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:24.296080 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:24.296080 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:24.296080 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:24.296080 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:24.296080 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:24.296080 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:24.296080 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:24.297520 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:24.297520 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:24.297520 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:24.297520 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:24.297520 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:24.297520 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:24.297520 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:24.297520 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:24.297520 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:24.297520 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:24.297520 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:24.297520 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:24.297520 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:24.297520 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:24.297520 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:24.297520 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:24.298311 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:24.298311 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:24.298311 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:24.298311 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:24.298311 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:24.298311 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:24.298311 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:24.298311 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:24.298311 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:24.298311 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:24.298311 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:12:24.298311 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:12:24.298311 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 141/286] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:24.305680 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32221f0-4181-4465-8a45-5795be5c3ce6 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:24.453151 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32221f0-4181-4465-8a45-5795be5c3ce6 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:24.467502 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a4939-19fb-419c-a043-5f3aef6b81c4 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:24.515983 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358b5aa-425c-42db-a275-80a3b7d95309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:24.516701 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358b5aa-425c-42db-a275-80a3b7d95309 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:24.516983 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358b5aa-425c-42db-a275-80a3b7d95309 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:24.517257 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358b5aa-425c-42db-a275-80a3b7d95309 None admin] PATH_INFO: `/v3/users/80812ade5db44dfd981fb76cd8ae9526` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:24.518463 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358b5aa-425c-42db-a275-80a3b7d95309 None admin] RBAC: Authorizing `identity:get_user(user_id=80812ade5db44dfd981fb76cd8ae9526)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:24.519835 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a855b1-ffe7-4d79-aad1-f9e299eaf447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:24.519959 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358b5aa-425c-42db-a275-80a3b7d95309 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:24.520467 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a855b1-ffe7-4d79-aad1-f9e299eaf447 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:24.520748 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a855b1-ffe7-4d79-aad1-f9e299eaf447 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:24.521023 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a855b1-ffe7-4d79-aad1-f9e299eaf447 None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:24.521744 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a855b1-ffe7-4d79-aad1-f9e299eaf447 None admin] RBAC: Adding query filter params (name=member) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:24.521921 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 146/287] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:12:24 2022] GET /identity/v3/users/80812ade5db44dfd981fb76cd8ae9526 => generated 297 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:24.522049 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a855b1-ffe7-4d79-aad1-f9e299eaf447 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:24.529019 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a855b1-ffe7-4d79-aad1-f9e299eaf447 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:24.530209 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358b5aa-425c-42db-a275-80a3b7d95309 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:24.535027 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 142/288] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 16:12:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:24.541712 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a855b1-ffe7-4d79-aad1-f9e299eaf447 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:24.581268 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:24.590818 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:24.695306 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a855b1-ffe7-4d79-aad1-f9e299eaf447 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:24.706474 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358b5aa-425c-42db-a275-80a3b7d95309 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:24.755189 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b0207-bf1f-47db-b8ae-9dc29465b2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:24.755876 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b0207-bf1f-47db-b8ae-9dc29465b2f0 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:24.756160 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b0207-bf1f-47db-b8ae-9dc29465b2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:24.756439 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b0207-bf1f-47db-b8ae-9dc29465b2f0 None admin] PATH_INFO: `/v3/users/ce969f6492674fa58d463563c0ed18ad` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:24.758343 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b0207-bf1f-47db-b8ae-9dc29465b2f0 None admin] RBAC: Authorizing `identity:get_user(user_id=ce969f6492674fa58d463563c0ed18ad)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:24.759823 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b0207-bf1f-47db-b8ae-9dc29465b2f0 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:24.761450 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 143/289] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:12:24 2022] GET /identity/v3/users/ce969f6492674fa58d463563c0ed18ad => generated 297 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:24.768586 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b0207-bf1f-47db-b8ae-9dc29465b2f0 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:24.784137 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318117f-01f6-43d7-802f-679ea7cbeb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:24.784803 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318117f-01f6-43d7-802f-679ea7cbeb88 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:24.785089 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318117f-01f6-43d7-802f-679ea7cbeb88 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:24.785368 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318117f-01f6-43d7-802f-679ea7cbeb88 None admin] PATH_INFO: `/v3/projects/bcb322d69d74445d9641596caf1b6a8e` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:24.786670 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318117f-01f6-43d7-802f-679ea7cbeb88 None admin] RBAC: Authorizing `identity:get_project(project_id=bcb322d69d74445d9641596caf1b6a8e)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:24.791019 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318117f-01f6-43d7-802f-679ea7cbeb88 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:24.795103 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 147/290] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:24 2022] GET /identity/v3/projects/bcb322d69d74445d9641596caf1b6a8e => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:24.804907 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318117f-01f6-43d7-802f-679ea7cbeb88 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:24.940743 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:24.957613 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b0207-bf1f-47db-b8ae-9dc29465b2f0 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:24.986943 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318117f-01f6-43d7-802f-679ea7cbeb88 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:25.010808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:25.021365 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b98617-7435-4bc3-96c5-5fad872eb4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:25.021997 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b98617-7435-4bc3-96c5-5fad872eb4d5 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:25.022284 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b98617-7435-4bc3-96c5-5fad872eb4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:25.022562 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b98617-7435-4bc3-96c5-5fad872eb4d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:25.050742 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc639d0-9c14-4f0f-aee6-be5a2f6be23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:25.051466 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc639d0-9c14-4f0f-aee6-be5a2f6be23a None admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:25.051756 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc639d0-9c14-4f0f-aee6-be5a2f6be23a None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:25.052034 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc639d0-9c14-4f0f-aee6-be5a2f6be23a None admin] PATH_INFO: `/v3/projects/bcb322d69d74445d9641596caf1b6a8e/users/80812ade5db44dfd981fb76cd8ae9526/roles/b9b668e0b625469fa54fa2eb74cbdb97` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:25.054895 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc639d0-9c14-4f0f-aee6-be5a2f6be23a None admin] RBAC: Authorizing `identity:create_grant(project_id=bcb322d69d74445d9641596caf1b6a8e, user_id=80812ade5db44dfd981fb76cd8ae9526, role_id=b9b668e0b625469fa54fa2eb74cbdb97)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:25.056401 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc639d0-9c14-4f0f-aee6-be5a2f6be23a None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:25.077238 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 148/291] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 16:12:24 2022] PUT /identity/v3/projects/bcb322d69d74445d9641596caf1b6a8e/users/80812ade5db44dfd981fb76cd8ae9526/roles/b9b668e0b625469fa54fa2eb74cbdb97 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:12:25.154764 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b98617-7435-4bc3-96c5-5fad872eb4d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:25.156286 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b98617-7435-4bc3-96c5-5fad872eb4d5 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:25.290610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:25.302288 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 144/292] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:12:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:12:25.308653 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc639d0-9c14-4f0f-aee6-be5a2f6be23a None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:25.447902 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc639d0-9c14-4f0f-aee6-be5a2f6be23a None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:25.483399 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646f31a-ef53-45f3-8331-3341da921e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:25.484622 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646f31a-ef53-45f3-8331-3341da921e1a None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:25.484930 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646f31a-ef53-45f3-8331-3341da921e1a None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:25.485220 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646f31a-ef53-45f3-8331-3341da921e1a None admin] PATH_INFO: `/v3/projects/bcb322d69d74445d9641596caf1b6a8e` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:25.486449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646f31a-ef53-45f3-8331-3341da921e1a None admin] RBAC: Authorizing `identity:get_project(project_id=bcb322d69d74445d9641596caf1b6a8e)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:25.487957 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646f31a-ef53-45f3-8331-3341da921e1a None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:25.494060 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 149/293] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:25 2022] GET /identity/v3/projects/bcb322d69d74445d9641596caf1b6a8e => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:25.496179 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b98617-7435-4bc3-96c5-5fad872eb4d5 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:25.654004 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b98617-7435-4bc3-96c5-5fad872eb4d5 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:25.717010 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635e319-6a36-4dd2-9b4e-7c53b6bf26ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:25.717662 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635e319-6a36-4dd2-9b4e-7c53b6bf26ad None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:25.718454 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635e319-6a36-4dd2-9b4e-7c53b6bf26ad None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:25.718746 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635e319-6a36-4dd2-9b4e-7c53b6bf26ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:25.719574 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635e319-6a36-4dd2-9b4e-7c53b6bf26ad None admin] RBAC: Adding query filter params (role.id=5698bc4d332140e9af77ddcbb9915736, scope.project.id=bcb322d69d74445d9641596caf1b6a8e, user.id=ce969f6492674fa58d463563c0ed18ad) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:25.719890 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635e319-6a36-4dd2-9b4e-7c53b6bf26ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:25.721332 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635e319-6a36-4dd2-9b4e-7c53b6bf26ad None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:25.732227 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 145/294] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 16:12:25 2022] GET /identity/v3/role_assignments?user.id=ce969f6492674fa58d463563c0ed18ad&scope.project.id=bcb322d69d74445d9641596caf1b6a8e&role.id=5698bc4d332140e9af77ddcbb9915736 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:26.449723 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f603865-edf5-4d99-bd4b-3b71877b0f01 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:26.450428 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f603865-edf5-4d99-bd4b-3b71877b0f01 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:26.450428 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f603865-edf5-4d99-bd4b-3b71877b0f01 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:26.451972 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 150/295] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:26.457180 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed1364-bd0c-4558-b20f-9eb86ecadc69 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:26.458049 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed1364-bd0c-4558-b20f-9eb86ecadc69 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:26.458542 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed1364-bd0c-4558-b20f-9eb86ecadc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:26.479461 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-faed1364-bd0c-4558-b20f-9eb86ecadc69 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:26.481102 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-faed1364-bd0c-4558-b20f-9eb86ecadc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:26.537043 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04861bd2-a638-437e-807f-75d082aeffa0 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:26.537602 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04861bd2-a638-437e-807f-75d082aeffa0 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:26.537834 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04861bd2-a638-437e-807f-75d082aeffa0 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:26.539345 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:26.540892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 151/296] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:12:26.549005 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe5825-3903-4ad6-99a2-45156f8fdc13 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:26.549567 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe5825-3903-4ad6-99a2-45156f8fdc13 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:26.550146 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe5825-3903-4ad6-99a2-45156f8fdc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:26.562230 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 146/297] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:26.570839 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-befe5825-3903-4ad6-99a2-45156f8fdc13 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:26.572476 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-befe5825-3903-4ad6-99a2-45156f8fdc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:26.589528 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed1364-bd0c-4558-b20f-9eb86ecadc69 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:26.607012 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:26.651449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 152/298] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:26.677380 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe5825-3903-4ad6-99a2-45156f8fdc13 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:26.707414 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed1364-bd0c-4558-b20f-9eb86ecadc69 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:26.750072 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705140e-ad12-4191-9c82-d719bcbd5b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:26.751226 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705140e-ad12-4191-9c82-d719bcbd5b14 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:26.751694 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705140e-ad12-4191-9c82-d719bcbd5b14 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:26.752258 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705140e-ad12-4191-9c82-d719bcbd5b14 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:26.765315 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705140e-ad12-4191-9c82-d719bcbd5b14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:26.770768 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-0705140e-ad12-4191-9c82-d719bcbd5b14 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:12:26.770768 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:26.770768 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:26.770768 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:26.770768 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:26.770768 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:26.770768 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:26.770768 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:26.770768 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:26.770768 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:26.770768 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:26.770768 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:26.770768 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:26.770768 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:26.770768 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:26.770768 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:26.771720 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:26.771720 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:26.771720 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:26.771720 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:26.771720 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:26.771720 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:26.771720 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:26.771720 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:26.771720 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:26.771720 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:26.771720 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:26.771720 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:26.771720 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:26.771720 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:26.771720 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:26.771720 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:26.772485 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:26.772485 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:26.772485 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:26.772485 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:26.772485 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:26.772485 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:26.772485 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:26.772485 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:26.772485 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:26.772485 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:26.772485 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:12:26.772485 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:12:26.779816 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 147/299] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:12:26.781030 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705140e-ad12-4191-9c82-d719bcbd5b14 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:26.800521 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe5825-3903-4ad6-99a2-45156f8fdc13 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:26.837800 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fe598-0362-4668-bf07-61694a8c9c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:26.838742 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fe598-0362-4668-bf07-61694a8c9c06 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:26.839197 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fe598-0362-4668-bf07-61694a8c9c06 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:26.839755 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:26.840218 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fe598-0362-4668-bf07-61694a8c9c06 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:26.842289 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9fe598-0362-4668-bf07-61694a8c9c06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:26.846586 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9fe598-0362-4668-bf07-61694a8c9c06 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:26.855922 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 153/300] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:12:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:26.859886 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fe598-0362-4668-bf07-61694a8c9c06 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:26.901202 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705140e-ad12-4191-9c82-d719bcbd5b14 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:26.924386 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:26.935959 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663117a4-29b8-49c9-8266-8c509bd1b386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:26.936578 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663117a4-29b8-49c9-8266-8c509bd1b386 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:26.936885 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663117a4-29b8-49c9-8266-8c509bd1b386 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:26.937157 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663117a4-29b8-49c9-8266-8c509bd1b386 None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:26.937866 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663117a4-29b8-49c9-8266-8c509bd1b386 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:26.938171 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663117a4-29b8-49c9-8266-8c509bd1b386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:26.939576 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663117a4-29b8-49c9-8266-8c509bd1b386 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:26.947594 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 148/301] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 16:12:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:26.948753 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a28154-9509-42c8-ba38-0767b4ddd650 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:26.949034 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a28154-9509-42c8-ba38-0767b4ddd650 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:26.949306 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a28154-9509-42c8-ba38-0767b4ddd650 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:26.950503 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 149/302] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:26.953410 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a28154-9509-42c8-ba38-0767b4ddd650 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:27.035884 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fe598-0362-4668-bf07-61694a8c9c06 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:27.069531 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b57ba2-c411-4228-97f5-16d56e549498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:27.070148 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b57ba2-c411-4228-97f5-16d56e549498 None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:27.070430 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b57ba2-c411-4228-97f5-16d56e549498 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:27.070705 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b57ba2-c411-4228-97f5-16d56e549498 None admin] PATH_INFO: `/v3/groups` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:27.071355 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b57ba2-c411-4228-97f5-16d56e549498 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:27.072829 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b57ba2-c411-4228-97f5-16d56e549498 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:27.095319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 154/303] 10.222.0.65 () {60 vars in 1134 bytes} [Wed Jul 27 16:12:26 2022] POST /identity/v3/groups => generated 229 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:12:27.095319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fa638-2925-4435-b653-a3b5aa322dd6 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:27.095319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fa638-2925-4435-b653-a3b5aa322dd6 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:27.095319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fa638-2925-4435-b653-a3b5aa322dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:27.106663 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a28154-9509-42c8-ba38-0767b4ddd650 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:27.114551 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-2f7fa638-2925-4435-b653-a3b5aa322dd6 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:27.115659 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:27.116586 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-2f7fa638-2925-4435-b653-a3b5aa322dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:27.162262 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d86185-6cf6-4318-a1c3-ed4cfb2f4ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:27.163398 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d86185-6cf6-4318-a1c3-ed4cfb2f4ade None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:27.163837 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d86185-6cf6-4318-a1c3-ed4cfb2f4ade None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:27.164190 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d86185-6cf6-4318-a1c3-ed4cfb2f4ade None admin] PATH_INFO: `/v3/users/63d74751e5524578b6916d9f65ffab89` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:27.184323 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d86185-6cf6-4318-a1c3-ed4cfb2f4ade None admin] RBAC: Authorizing `identity:get_user(user_id=63d74751e5524578b6916d9f65ffab89)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:27.186265 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d86185-6cf6-4318-a1c3-ed4cfb2f4ade None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:27.191553 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 150/304] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:12:26 2022] GET /identity/v3/users/63d74751e5524578b6916d9f65ffab89 => generated 293 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:27.195534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d86185-6cf6-4318-a1c3-ed4cfb2f4ade None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:27.204852 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 155/305] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:27.228500 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fa638-2925-4435-b653-a3b5aa322dd6 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:27.258494 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:27.314035 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d86185-6cf6-4318-a1c3-ed4cfb2f4ade None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:27.342303 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fa638-2925-4435-b653-a3b5aa322dd6 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:27.354157 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59295198-422a-4116-beb7-9190050cf4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:27.354441 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59295198-422a-4116-beb7-9190050cf4fb None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:27.354754 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59295198-422a-4116-beb7-9190050cf4fb None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:27.354994 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59295198-422a-4116-beb7-9190050cf4fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:27.355800 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59295198-422a-4116-beb7-9190050cf4fb None admin] RBAC: Adding query filter params (role.id=b9b668e0b625469fa54fa2eb74cbdb97, user.id=63d74751e5524578b6916d9f65ffab89, scope.system=all) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:27.356206 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59295198-422a-4116-beb7-9190050cf4fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:27.358631 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59295198-422a-4116-beb7-9190050cf4fb None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:27.364075 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 151/306] 10.222.0.65 () {56 vars in 1308 bytes} [Wed Jul 27 16:12:27 2022] GET /identity/v3/role_assignments?user.id=63d74751e5524578b6916d9f65ffab89&scope.system=all&role.id=b9b668e0b625469fa54fa2eb74cbdb97 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:27.396724 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5298a-50ca-439e-a055-85d9f226edc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:27.397406 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5298a-50ca-439e-a055-85d9f226edc3 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:27.397693 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5298a-50ca-439e-a055-85d9f226edc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:27.397970 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5298a-50ca-439e-a055-85d9f226edc3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:27.413875 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5298a-50ca-439e-a055-85d9f226edc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:27.419164 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-21f5298a-50ca-439e-a055-85d9f226edc3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:12:27.419164 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:27.419164 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:27.419164 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:27.419164 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:27.419164 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:27.419164 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:27.419164 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:27.419164 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:27.419164 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:27.419164 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:27.419164 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:27.419164 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:27.419164 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:27.419164 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:27.419164 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:27.420127 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:27.420127 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:27.420127 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:27.420127 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:27.420127 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:27.420127 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:27.420127 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:27.420127 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:27.420127 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:27.420127 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:27.420127 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:27.420127 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:27.420127 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:27.420127 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:27.420127 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:27.420127 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:27.420937 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:27.420937 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:27.420937 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:27.420937 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:27.420937 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:27.420937 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:27.420937 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:27.420937 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:27.420937 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:27.420937 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:27.420937 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:12:27.420937 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:27.420937 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 156/307] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:27.426806 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59295198-422a-4116-beb7-9190050cf4fb None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:27.461870 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:27.549694 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59295198-422a-4116-beb7-9190050cf4fb None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:27.587284 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14c0c4-a23a-4c97-ae3b-d53980b31f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:27.587865 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14c0c4-a23a-4c97-ae3b-d53980b31f7c None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:27.588153 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14c0c4-a23a-4c97-ae3b-d53980b31f7c None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:27.588432 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14c0c4-a23a-4c97-ae3b-d53980b31f7c None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:27.589157 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14c0c4-a23a-4c97-ae3b-d53980b31f7c None admin] RBAC: Adding query filter params (name=member) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:27.589467 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14c0c4-a23a-4c97-ae3b-d53980b31f7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:27.590849 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14c0c4-a23a-4c97-ae3b-d53980b31f7c None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:27.600886 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 152/308] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 16:12:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:27.606502 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5298a-50ca-439e-a055-85d9f226edc3 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:27.710250 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:27.727409 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5298a-50ca-439e-a055-85d9f226edc3 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:27.764388 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ac0da-76ca-4cd7-b187-8e0f3a78bd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:27.765078 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ac0da-76ca-4cd7-b187-8e0f3a78bd48 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:27.765364 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ac0da-76ca-4cd7-b187-8e0f3a78bd48 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:27.765644 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ac0da-76ca-4cd7-b187-8e0f3a78bd48 None admin] PATH_INFO: `/v3/users/c02f8557e76c4e7cbfb100dbad153ad5` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:27.766831 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ac0da-76ca-4cd7-b187-8e0f3a78bd48 None admin] RBAC: Authorizing `identity:get_user(user_id=c02f8557e76c4e7cbfb100dbad153ad5)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:27.768427 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ac0da-76ca-4cd7-b187-8e0f3a78bd48 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:27.770335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 157/309] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:12:27 2022] GET /identity/v3/users/c02f8557e76c4e7cbfb100dbad153ad5 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:27.776047 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14c0c4-a23a-4c97-ae3b-d53980b31f7c None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:27.884762 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:27.896187 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14c0c4-a23a-4c97-ae3b-d53980b31f7c None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:27.933045 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4694408-c0b3-48f6-b881-80fbf5c417dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:27.933728 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4694408-c0b3-48f6-b881-80fbf5c417dc None admin] REQUEST_METHOD: `PUT` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:27.934010 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4694408-c0b3-48f6-b881-80fbf5c417dc None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:27.934349 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4694408-c0b3-48f6-b881-80fbf5c417dc None admin] PATH_INFO: `/v3/system/users/c02f8557e76c4e7cbfb100dbad153ad5/roles/5698bc4d332140e9af77ddcbb9915736` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:27.935929 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4694408-c0b3-48f6-b881-80fbf5c417dc None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c02f8557e76c4e7cbfb100dbad153ad5, role_id=5698bc4d332140e9af77ddcbb9915736)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:27.937357 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4694408-c0b3-48f6-b881-80fbf5c417dc None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:27.947286 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 153/310] 10.222.0.65 () {58 vars in 1334 bytes} [Wed Jul 27 16:12:27 2022] PUT /identity/v3/system/users/c02f8557e76c4e7cbfb100dbad153ad5/roles/5698bc4d332140e9af77ddcbb9915736 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:12:27.979816 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd3e26-b5f7-4d9e-afe6-67dc3d1f0af2 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:27.980164 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd3e26-b5f7-4d9e-afe6-67dc3d1f0af2 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:27.980381 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd3e26-b5f7-4d9e-afe6-67dc3d1f0af2 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:27.981980 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 158/311] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:27.988615 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c801b20-ad5b-4a62-ab57-78f9e92b5d47 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:27.988897 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c801b20-ad5b-4a62-ab57-78f9e92b5d47 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:27.989177 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c801b20-ad5b-4a62-ab57-78f9e92b5d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:28.010621 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-4c801b20-ad5b-4a62-ab57-78f9e92b5d47 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:28.011904 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-4c801b20-ad5b-4a62-ab57-78f9e92b5d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:28.092561 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 154/312] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:12:28.126001 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd3e26-b5f7-4d9e-afe6-67dc3d1f0af2 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:28.244249 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd3e26-b5f7-4d9e-afe6-67dc3d1f0af2 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:28.280705 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8997c35-3792-4a8a-9def-e18b90bf9b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:28.281354 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8997c35-3792-4a8a-9def-e18b90bf9b87 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:28.281639 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8997c35-3792-4a8a-9def-e18b90bf9b87 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:28.281915 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8997c35-3792-4a8a-9def-e18b90bf9b87 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:28.292919 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8997c35-3792-4a8a-9def-e18b90bf9b87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:28.298569 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-f8997c35-3792-4a8a-9def-e18b90bf9b87 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:12:28.298569 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:28.298569 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:28.298569 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:28.298569 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:28.298569 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:28.298569 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:28.298569 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:28.298569 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:28.298569 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:28.298569 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:28.298569 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:28.298569 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:28.298569 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:28.298569 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:28.298569 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:28.299457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:28.299457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:28.299457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:28.299457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:28.299457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:28.299457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:28.299457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:28.299457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:28.299457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:28.299457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:28.299457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:28.299457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:28.299457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:28.299457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:28.299457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:28.299457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:28.300248 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:28.300248 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:28.300248 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:28.300248 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:28.300248 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:28.300248 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:28.300248 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:28.300248 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:28.300248 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:28.300248 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:28.300248 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:12:28.300248 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:28.300846 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 159/313] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:28.307186 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c801b20-ad5b-4a62-ab57-78f9e92b5d47 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:28.400047 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:28.420439 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c801b20-ad5b-4a62-ab57-78f9e92b5d47 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:28.456977 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771cb7c-c537-4bfb-8d34-c674266845a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:28.457611 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771cb7c-c537-4bfb-8d34-c674266845a4 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:28.457894 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771cb7c-c537-4bfb-8d34-c674266845a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:28.458170 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771cb7c-c537-4bfb-8d34-c674266845a4 None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:28.458887 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771cb7c-c537-4bfb-8d34-c674266845a4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:28.459194 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771cb7c-c537-4bfb-8d34-c674266845a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:28.460603 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771cb7c-c537-4bfb-8d34-c674266845a4 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:28.469416 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 155/314] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 16:12:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:28.475066 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8997c35-3792-4a8a-9def-e18b90bf9b87 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:28.492875 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:28.591513 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8997c35-3792-4a8a-9def-e18b90bf9b87 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:28.627779 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d4227-a3ed-4580-ad67-a545a0675781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:28.628519 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d4227-a3ed-4580-ad67-a545a0675781 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:28.628710 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d4227-a3ed-4580-ad67-a545a0675781 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:28.628988 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d4227-a3ed-4580-ad67-a545a0675781 None admin] PATH_INFO: `/v3/users/80812ade5db44dfd981fb76cd8ae9526` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:28.630165 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d4227-a3ed-4580-ad67-a545a0675781 None admin] RBAC: Authorizing `identity:get_user(user_id=80812ade5db44dfd981fb76cd8ae9526)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:28.631654 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d4227-a3ed-4580-ad67-a545a0675781 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:28.633577 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 160/315] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:12:28 2022] GET /identity/v3/users/80812ade5db44dfd981fb76cd8ae9526 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:28.640526 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771cb7c-c537-4bfb-8d34-c674266845a4 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:28.757539 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771cb7c-c537-4bfb-8d34-c674266845a4 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:28.792623 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146c0de-6fed-4bf6-9cc1-415d9e2b1724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:28.794070 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146c0de-6fed-4bf6-9cc1-415d9e2b1724 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:28.794070 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146c0de-6fed-4bf6-9cc1-415d9e2b1724 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:28.794070 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146c0de-6fed-4bf6-9cc1-415d9e2b1724 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:28.811078 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:28.870515 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146c0de-6fed-4bf6-9cc1-415d9e2b1724 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:28.872298 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146c0de-6fed-4bf6-9cc1-415d9e2b1724 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:28.974346 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 156/316] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:12:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:12:28.979854 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d4227-a3ed-4580-ad67-a545a0675781 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:29.073270 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:29.092485 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d4227-a3ed-4580-ad67-a545a0675781 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:29.128399 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c1f2f-f426-46b4-891d-54545d32dcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:29.128953 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c1f2f-f426-46b4-891d-54545d32dcb9 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:29.129239 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c1f2f-f426-46b4-891d-54545d32dcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:29.129514 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c1f2f-f426-46b4-891d-54545d32dcb9 None admin] PATH_INFO: `/v3/projects/bcb322d69d74445d9641596caf1b6a8e` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:29.130707 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c1f2f-f426-46b4-891d-54545d32dcb9 None admin] RBAC: Authorizing `identity:get_project(project_id=bcb322d69d74445d9641596caf1b6a8e)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:29.132184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c1f2f-f426-46b4-891d-54545d32dcb9 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:29.134162 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 161/317] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:28 2022] GET /identity/v3/projects/bcb322d69d74445d9641596caf1b6a8e => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:29.144055 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146c0de-6fed-4bf6-9cc1-415d9e2b1724 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:29.223154 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:29.298253 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146c0de-6fed-4bf6-9cc1-415d9e2b1724 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:29.335253 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e993d-e1e9-4a5e-a932-a7d9a681a3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:29.335914 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e993d-e1e9-4a5e-a932-a7d9a681a3ea None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:29.336194 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e993d-e1e9-4a5e-a932-a7d9a681a3ea None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:29.336468 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e993d-e1e9-4a5e-a932-a7d9a681a3ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:29.337259 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e993d-e1e9-4a5e-a932-a7d9a681a3ea None admin] RBAC: Adding query filter params (role.id=b9b668e0b625469fa54fa2eb74cbdb97, scope.project.id=bcb322d69d74445d9641596caf1b6a8e, user.id=80812ade5db44dfd981fb76cd8ae9526) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:29.337573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e993d-e1e9-4a5e-a932-a7d9a681a3ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:29.339006 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e993d-e1e9-4a5e-a932-a7d9a681a3ea None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:29.345525 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 157/318] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 16:12:29 2022] GET /identity/v3/role_assignments?user.id=80812ade5db44dfd981fb76cd8ae9526&scope.project.id=bcb322d69d74445d9641596caf1b6a8e&role.id=b9b668e0b625469fa54fa2eb74cbdb97 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:29.713651 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82620f4b-9613-4c10-981c-882052648d5c None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:29.714154 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82620f4b-9613-4c10-981c-882052648d5c None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:29.714226 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82620f4b-9613-4c10-981c-882052648d5c None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:29.715596 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 162/319] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:29.721923 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0668451-7412-4aef-a01f-f30596128aec None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:29.722470 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0668451-7412-4aef-a01f-f30596128aec None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:29.722549 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0668451-7412-4aef-a01f-f30596128aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:29.742621 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-d0668451-7412-4aef-a01f-f30596128aec None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:29.744030 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-d0668451-7412-4aef-a01f-f30596128aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:29.792076 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7c396-3398-43a9-b997-f06d223daca7 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:29.792358 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7c396-3398-43a9-b997-f06d223daca7 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:29.792790 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7c396-3398-43a9-b997-f06d223daca7 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:29.794269 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 163/320] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:29.799579 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11917c-d71e-4329-850a-643facff1ab6 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:29.799870 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11917c-d71e-4329-850a-643facff1ab6 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:29.800154 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11917c-d71e-4329-850a-643facff1ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:29.819113 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-fa11917c-d71e-4329-850a-643facff1ab6 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:29.819299 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 158/321] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:12:29.820368 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-fa11917c-d71e-4329-850a-643facff1ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:29.846666 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0668451-7412-4aef-a01f-f30596128aec None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:29.890578 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:29.892158 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 164/322] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:12:29.914794 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11917c-d71e-4329-850a-643facff1ab6 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:29.963301 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0668451-7412-4aef-a01f-f30596128aec None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:30.005185 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:30.011136 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b94596-00cb-45d1-bbe9-9c8259a24d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:30.011826 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b94596-00cb-45d1-bbe9-9c8259a24d95 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:30.012112 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b94596-00cb-45d1-bbe9-9c8259a24d95 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:30.012391 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b94596-00cb-45d1-bbe9-9c8259a24d95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:30.013552 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b94596-00cb-45d1-bbe9-9c8259a24d95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:30.015083 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b94596-00cb-45d1-bbe9-9c8259a24d95 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:30.016725 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 159/323] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:12:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:30.022326 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b94596-00cb-45d1-bbe9-9c8259a24d95 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:30.026408 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11917c-d71e-4329-850a-643facff1ab6 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:30.063833 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74c804-8c6e-4f97-a779-f889efcbad39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:30.064486 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74c804-8c6e-4f97-a779-f889efcbad39 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:30.064758 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74c804-8c6e-4f97-a779-f889efcbad39 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:30.065029 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74c804-8c6e-4f97-a779-f889efcbad39 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:30.075358 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f74c804-8c6e-4f97-a779-f889efcbad39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:30.080892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-5f74c804-8c6e-4f97-a779-f889efcbad39 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:12:30.080892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:30.080892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:30.080892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:30.080892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:30.080892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:30.080892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:30.080892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:30.080892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:30.080892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:30.080892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:30.080892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:30.080892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:30.080892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:30.080892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:30.080892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:30.081773 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:30.081773 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:30.081773 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:30.081773 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:30.081773 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:30.081773 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:30.081773 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:30.081773 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:30.081773 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:30.081773 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:30.081773 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:30.081773 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:30.081773 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:30.081773 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:30.081773 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:30.081773 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:30.083184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:30.083184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:30.083184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:30.083184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:30.083184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:30.083184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:30.083184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:30.083184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:30.083184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:30.083184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:30.083184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:12:30.083184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:30.083184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 165/324] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:12:30.087772 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74c804-8c6e-4f97-a779-f889efcbad39 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:30.131596 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b94596-00cb-45d1-bbe9-9c8259a24d95 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:30.142301 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:30.170141 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb9485-8a77-4f5c-b2ec-6acc4c77e91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:30.170820 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb9485-8a77-4f5c-b2ec-6acc4c77e91a None admin] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:30.171200 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb9485-8a77-4f5c-b2ec-6acc4c77e91a None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:30.171658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb9485-8a77-4f5c-b2ec-6acc4c77e91a None admin] PATH_INFO: `/v3/groups` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:30.172470 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb9485-8a77-4f5c-b2ec-6acc4c77e91a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:30.173922 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb9485-8a77-4f5c-b2ec-6acc4c77e91a None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:30.191571 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74c804-8c6e-4f97-a779-f889efcbad39 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:30.192804 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 160/325] 10.222.0.65 () {60 vars in 1134 bytes} [Wed Jul 27 16:12:30 2022] POST /identity/v3/groups => generated 226 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:12:30.231498 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b6607-3f21-4bb1-a00c-50dae4fad3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:30.232047 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b6607-3f21-4bb1-a00c-50dae4fad3b1 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:30.232314 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b6607-3f21-4bb1-a00c-50dae4fad3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:30.232710 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b6607-3f21-4bb1-a00c-50dae4fad3b1 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:30.233360 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b6607-3f21-4bb1-a00c-50dae4fad3b1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:30.234257 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b6607-3f21-4bb1-a00c-50dae4fad3b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:30.235796 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b6607-3f21-4bb1-a00c-50dae4fad3b1 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:30.245906 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 166/326] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 16:12:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:30.252513 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb9485-8a77-4f5c-b2ec-6acc4c77e91a None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:30.364884 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb9485-8a77-4f5c-b2ec-6acc4c77e91a None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:30.403736 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755fc18-2774-4960-9179-4a26d852783a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:30.404406 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755fc18-2774-4960-9179-4a26d852783a None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:30.404691 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755fc18-2774-4960-9179-4a26d852783a None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:30.404968 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47afd1-da81-49db-ac38-38764afc40bd None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:30.405065 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755fc18-2774-4960-9179-4a26d852783a None admin] PATH_INFO: `/v3/users/63d74751e5524578b6916d9f65ffab89` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:30.405255 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47afd1-da81-49db-ac38-38764afc40bd None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:30.405633 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47afd1-da81-49db-ac38-38764afc40bd None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:30.406210 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2755fc18-2774-4960-9179-4a26d852783a None admin] RBAC: Authorizing `identity:get_user(user_id=63d74751e5524578b6916d9f65ffab89)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:30.407082 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 167/327] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:12:30.407781 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2755fc18-2774-4960-9179-4a26d852783a None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:30.409468 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 161/328] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:12:30 2022] GET /identity/v3/users/63d74751e5524578b6916d9f65ffab89 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:30.413109 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c2200-56d4-4f2a-9b1e-95c5e60f50d8 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:30.413625 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c2200-56d4-4f2a-9b1e-95c5e60f50d8 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:30.414179 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c2200-56d4-4f2a-9b1e-95c5e60f50d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:30.415589 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755fc18-2774-4960-9179-4a26d852783a None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:30.426977 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:30.442388 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-5e0c2200-56d4-4f2a-9b1e-95c5e60f50d8 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:30.443679 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-5e0c2200-56d4-4f2a-9b1e-95c5e60f50d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:30.462507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:30.533374 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 168/329] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:30.547249 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755fc18-2774-4960-9179-4a26d852783a None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:30.558625 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c2200-56d4-4f2a-9b1e-95c5e60f50d8 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:30.590747 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfff643-5e0f-4dc6-bbbf-61c2deb98f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:30.591882 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfff643-5e0f-4dc6-bbbf-61c2deb98f20 None admin] REQUEST_METHOD: `PUT` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:30.592386 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfff643-5e0f-4dc6-bbbf-61c2deb98f20 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:30.592855 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfff643-5e0f-4dc6-bbbf-61c2deb98f20 None admin] PATH_INFO: `/v3/system/users/63d74751e5524578b6916d9f65ffab89/roles/b9b668e0b625469fa54fa2eb74cbdb97` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:30.595166 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfff643-5e0f-4dc6-bbbf-61c2deb98f20 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=63d74751e5524578b6916d9f65ffab89, role_id=b9b668e0b625469fa54fa2eb74cbdb97)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:30.596818 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfff643-5e0f-4dc6-bbbf-61c2deb98f20 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:30.605748 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 162/330] 10.222.0.65 () {58 vars in 1334 bytes} [Wed Jul 27 16:12:30 2022] PUT /identity/v3/system/users/63d74751e5524578b6916d9f65ffab89/roles/b9b668e0b625469fa54fa2eb74cbdb97 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:12:30.690615 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c2200-56d4-4f2a-9b1e-95c5e60f50d8 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:30.726263 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:30.731562 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9ae78-0c10-466d-9915-115037099bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:30.732849 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9ae78-0c10-466d-9915-115037099bf9 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:30.733507 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9ae78-0c10-466d-9915-115037099bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:30.734307 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9ae78-0c10-466d-9915-115037099bf9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:30.747145 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda9ae78-0c10-466d-9915-115037099bf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:30.753383 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-bda9ae78-0c10-466d-9915-115037099bf9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:12:30.753383 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:30.753383 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:30.753383 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:30.753383 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:30.753383 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:30.753383 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:30.753383 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:30.753383 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:30.753383 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:30.753383 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:30.753383 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:30.753383 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:30.753383 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:30.753383 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:30.753383 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:30.754330 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:30.754330 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:30.754330 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:30.754330 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:30.754330 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:30.754330 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:30.754330 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:30.754330 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:30.754330 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:30.754330 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:30.754330 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:30.754330 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:30.754330 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:30.754330 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:30.754330 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:30.754330 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:30.755112 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:30.755112 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:30.755112 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:30.755112 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:30.755112 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:30.755112 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:30.755112 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:30.755112 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:30.755112 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:30.755112 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:30.755112 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:12:30.755112 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:30.757601 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 169/331] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:30.763919 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfff643-5e0f-4dc6-bbbf-61c2deb98f20 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:30.903734 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:30.907701 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfff643-5e0f-4dc6-bbbf-61c2deb98f20 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:30.955188 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085b190-25f4-4283-b5a3-e7b85e0ec308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:30.955877 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085b190-25f4-4283-b5a3-e7b85e0ec308 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:30.956161 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085b190-25f4-4283-b5a3-e7b85e0ec308 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:30.956429 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085b190-25f4-4283-b5a3-e7b85e0ec308 None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:30.957147 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085b190-25f4-4283-b5a3-e7b85e0ec308 None admin] RBAC: Adding query filter params (name=member) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:30.957512 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085b190-25f4-4283-b5a3-e7b85e0ec308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:30.958948 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085b190-25f4-4283-b5a3-e7b85e0ec308 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:30.970446 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 163/332] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 16:12:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:30.975673 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9ae78-0c10-466d-9915-115037099bf9 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:31.098076 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9ae78-0c10-466d-9915-115037099bf9 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:31.134948 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b221d0e-cfdd-4ef8-bf0b-817f2a0485c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:31.135633 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b221d0e-cfdd-4ef8-bf0b-817f2a0485c9 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:31.135973 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b221d0e-cfdd-4ef8-bf0b-817f2a0485c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:31.136273 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b221d0e-cfdd-4ef8-bf0b-817f2a0485c9 None admin] PATH_INFO: `/v3/users/c02f8557e76c4e7cbfb100dbad153ad5` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:31.137473 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b221d0e-cfdd-4ef8-bf0b-817f2a0485c9 None admin] RBAC: Authorizing `identity:get_user(user_id=c02f8557e76c4e7cbfb100dbad153ad5)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:31.138936 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b221d0e-cfdd-4ef8-bf0b-817f2a0485c9 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:31.141476 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 170/333] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:12:30 2022] GET /identity/v3/users/c02f8557e76c4e7cbfb100dbad153ad5 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:31.147023 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085b190-25f4-4283-b5a3-e7b85e0ec308 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:31.263639 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085b190-25f4-4283-b5a3-e7b85e0ec308 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:31.305738 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f763ee9-bd3b-469f-ab6e-bfaad2822448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:31.306366 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f763ee9-bd3b-469f-ab6e-bfaad2822448 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:31.306646 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f763ee9-bd3b-469f-ab6e-bfaad2822448 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:31.306920 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f763ee9-bd3b-469f-ab6e-bfaad2822448 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:31.307894 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f763ee9-bd3b-469f-ab6e-bfaad2822448 None admin] RBAC: Adding query filter params (role.id=5698bc4d332140e9af77ddcbb9915736, user.id=c02f8557e76c4e7cbfb100dbad153ad5, scope.system=all) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:31.308253 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f763ee9-bd3b-469f-ab6e-bfaad2822448 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:31.309687 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f763ee9-bd3b-469f-ab6e-bfaad2822448 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:31.325475 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 164/334] 10.222.0.65 () {56 vars in 1308 bytes} [Wed Jul 27 16:12:31 2022] GET /identity/v3/role_assignments?user.id=c02f8557e76c4e7cbfb100dbad153ad5&scope.system=all&role.id=5698bc4d332140e9af77ddcbb9915736 => generated 510 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:32.894715 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debec04d-107e-42b3-b416-e89a8d451e29 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:32.895757 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debec04d-107e-42b3-b416-e89a8d451e29 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:32.896245 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debec04d-107e-42b3-b416-e89a8d451e29 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:32.898435 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 171/335] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:32.903815 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60976de4-4e01-4299-b632-2d2ae6c60cc0 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:32.904767 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60976de4-4e01-4299-b632-2d2ae6c60cc0 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:32.905251 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60976de4-4e01-4299-b632-2d2ae6c60cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:32.931465 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-60976de4-4e01-4299-b632-2d2ae6c60cc0 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:32.932989 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-60976de4-4e01-4299-b632-2d2ae6c60cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:32.952243 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:33.026551 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 165/336] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:33.074927 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debec04d-107e-42b3-b416-e89a8d451e29 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:33.159788 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:33.219598 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debec04d-107e-42b3-b416-e89a8d451e29 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:33.242075 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067729b6-173d-4f0c-95c9-46050bc72701 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:33.242075 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067729b6-173d-4f0c-95c9-46050bc72701 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:33.242075 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067729b6-173d-4f0c-95c9-46050bc72701 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:33.242764 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 166/337] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:12:33.248019 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1171151-a717-4d9d-b69f-937cd407532c None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:33.251117 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1171151-a717-4d9d-b69f-937cd407532c None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:33.251682 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1171151-a717-4d9d-b69f-937cd407532c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:33.263083 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ac3d7-0f31-4fd7-af96-3a920efcfaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:33.263807 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ac3d7-0f31-4fd7-af96-3a920efcfaec None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:33.264090 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ac3d7-0f31-4fd7-af96-3a920efcfaec None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:33.264361 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ac3d7-0f31-4fd7-af96-3a920efcfaec None admin] PATH_INFO: `/v3/roles/member` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:33.275408 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548ac3d7-0f31-4fd7-af96-3a920efcfaec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:33.280366 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-548ac3d7-0f31-4fd7-af96-3a920efcfaec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:12:33.280366 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:33.280366 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:33.280366 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:33.280366 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:33.280366 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:33.280366 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:33.280366 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:33.280366 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:33.280366 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:33.280366 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:33.280366 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:33.280366 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:33.280366 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:33.280366 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:33.280366 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:33.281810 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:33.281810 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:33.281810 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:33.281810 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:33.281810 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:33.281810 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:33.281810 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:33.281810 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:33.281810 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:33.281810 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:33.281810 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:33.281810 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:33.281810 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:33.281810 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:33.281810 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:33.281810 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:33.282633 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:33.282633 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:33.282633 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:33.282633 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:33.282633 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:33.282633 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:33.282633 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:33.282633 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:33.282633 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:33.282633 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:33.282633 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:12:33.282633 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:33.282633 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 172/338] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:33.288486 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ac3d7-0f31-4fd7-af96-3a920efcfaec None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:33.293206 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-f1171151-a717-4d9d-b69f-937cd407532c None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:33.295491 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-f1171151-a717-4d9d-b69f-937cd407532c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:33.417788 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 167/339] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:12:33.459215 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1171151-a717-4d9d-b69f-937cd407532c None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:33.490299 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ac3d7-0f31-4fd7-af96-3a920efcfaec None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:33.524120 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:33.558242 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd810d-bc09-44e5-9442-9337bed674b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:33.559002 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd810d-bc09-44e5-9442-9337bed674b3 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:33.559293 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd810d-bc09-44e5-9442-9337bed674b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:33.559654 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd810d-bc09-44e5-9442-9337bed674b3 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:33.560379 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd810d-bc09-44e5-9442-9337bed674b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:33.560792 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd810d-bc09-44e5-9442-9337bed674b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:33.562668 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd810d-bc09-44e5-9442-9337bed674b3 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:33.583426 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 173/340] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 16:12:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:33.585292 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd810d-bc09-44e5-9442-9337bed674b3 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:33.590894 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:33.621936 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1171151-a717-4d9d-b69f-937cd407532c None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:33.719733 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f2f15-b92a-43fe-97d9-78a13a91eb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:33.720666 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f2f15-b92a-43fe-97d9-78a13a91eb4b None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:33.721130 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f2f15-b92a-43fe-97d9-78a13a91eb4b None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:33.721570 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f2f15-b92a-43fe-97d9-78a13a91eb4b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:33.748663 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f2f15-b92a-43fe-97d9-78a13a91eb4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:33.754521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-aa2f2f15-b92a-43fe-97d9-78a13a91eb4b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:12:33.754521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:33.754521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:33.754521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:33.754521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:33.754521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:33.754521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:33.754521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:33.754521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:33.754521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:33.754521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:33.754521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:33.754521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:33.754521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:33.754521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:33.754521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:33.755594 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:33.755594 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:33.755594 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:33.755594 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:33.755594 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:33.755594 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:33.755594 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:33.755594 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:33.755594 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:33.755594 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:33.755594 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:33.755594 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:33.755594 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:33.755594 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:33.755594 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:33.755594 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:33.756533 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:33.756533 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:33.756533 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:33.756533 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:33.756533 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:33.756533 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:33.756533 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:33.756533 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:33.756533 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:33.756533 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:33.756533 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:12:33.756533 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:12:33.758451 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 168/341] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:33.764650 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f2f15-b92a-43fe-97d9-78a13a91eb4b None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:33.833599 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd810d-bc09-44e5-9442-9337bed674b3 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:33.920546 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1094112-f98e-4805-a138-4eb2f8556ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:33.922828 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1094112-f98e-4805-a138-4eb2f8556ad0 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:33.923312 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1094112-f98e-4805-a138-4eb2f8556ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:33.923771 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1094112-f98e-4805-a138-4eb2f8556ad0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:34.009827 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:34.027514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f2f15-b92a-43fe-97d9-78a13a91eb4b None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:34.045936 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1094112-f98e-4805-a138-4eb2f8556ad0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:34.048119 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1094112-f98e-4805-a138-4eb2f8556ad0 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:34.108329 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8fdb9a-f53a-417a-ab12-4e86739e1b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:34.109023 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fdb9a-f53a-417a-ab12-4e86739e1b51 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:34.109310 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fdb9a-f53a-417a-ab12-4e86739e1b51 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:34.109587 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fdb9a-f53a-417a-ab12-4e86739e1b51 None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:34.110310 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8fdb9a-f53a-417a-ab12-4e86739e1b51 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:34.110617 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8fdb9a-f53a-417a-ab12-4e86739e1b51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:34.112043 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8fdb9a-f53a-417a-ab12-4e86739e1b51 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:34.132050 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 169/342] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 16:12:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:34.135676 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32641a-4570-4844-a56a-3d74ba624250 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:34.135983 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32641a-4570-4844-a56a-3d74ba624250 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:34.136263 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32641a-4570-4844-a56a-3d74ba624250 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:34.139526 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 170/343] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:34.141777 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32641a-4570-4844-a56a-3d74ba624250 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:34.148868 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:34.193598 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 174/344] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:12:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:12:34.194912 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5ffa4-fc21-4cab-bd45-157f8ca8e869 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:34.195212 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5ffa4-fc21-4cab-bd45-157f8ca8e869 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:34.195523 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5ffa4-fc21-4cab-bd45-157f8ca8e869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:34.214753 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-e3c5ffa4-fc21-4cab-bd45-157f8ca8e869 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:34.215980 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-e3c5ffa4-fc21-4cab-bd45-157f8ca8e869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:34.305670 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 175/345] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:34.306547 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5ffa4-fc21-4cab-bd45-157f8ca8e869 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:34.324678 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32641a-4570-4844-a56a-3d74ba624250 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:34.335758 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:34.387785 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64070a83-98c9-49bd-b4c7-01558a6cdb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:34.388524 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64070a83-98c9-49bd-b4c7-01558a6cdb33 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:34.389045 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64070a83-98c9-49bd-b4c7-01558a6cdb33 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:34.389340 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64070a83-98c9-49bd-b4c7-01558a6cdb33 None admin] PATH_INFO: `/v3/users/63d74751e5524578b6916d9f65ffab89` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:34.391278 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64070a83-98c9-49bd-b4c7-01558a6cdb33 None admin] RBAC: Authorizing `identity:get_user(user_id=63d74751e5524578b6916d9f65ffab89)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:34.393892 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64070a83-98c9-49bd-b4c7-01558a6cdb33 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:34.396094 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 171/346] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 16:12:34 2022] GET /identity/v3/users/63d74751e5524578b6916d9f65ffab89 => generated 293 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:34.397028 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64070a83-98c9-49bd-b4c7-01558a6cdb33 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:34.502350 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:34.549654 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64070a83-98c9-49bd-b4c7-01558a6cdb33 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:34.562942 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5ffa4-fc21-4cab-bd45-157f8ca8e869 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:34.600799 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35add3a5-225d-4e3d-8665-2763082ae164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:34.601880 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35add3a5-225d-4e3d-8665-2763082ae164 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:34.602722 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35add3a5-225d-4e3d-8665-2763082ae164 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:34.603108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35add3a5-225d-4e3d-8665-2763082ae164 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:34.617397 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2ad49-53db-4475-b66b-3318833b6011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:34.618280 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2ad49-53db-4475-b66b-3318833b6011 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:34.618699 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2ad49-53db-4475-b66b-3318833b6011 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:34.619140 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2ad49-53db-4475-b66b-3318833b6011 None admin] PATH_INFO: `/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:34.620454 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35add3a5-225d-4e3d-8665-2763082ae164 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:34.621034 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2ad49-53db-4475-b66b-3318833b6011 None admin] RBAC: Authorizing `identity:get_project(project_id=8ac4a2d636fc4ebdb5fd8e84d1834c46)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:34.622609 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2ad49-53db-4475-b66b-3318833b6011 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:34.625591 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 176/347] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:34 2022] GET /identity/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46 => generated 298 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:34.626995 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2ad49-53db-4475-b66b-3318833b6011 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:34.627510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-35add3a5-225d-4e3d-8665-2763082ae164 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:12:34.627510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:34.627510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:34.627510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:34.627510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:34.627510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:34.627510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:34.627510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:34.627510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:34.627510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:34.627510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:34.627510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:34.627510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:34.627510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:34.627510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:34.627510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:34.628507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:34.628507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:34.628507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:34.628507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:34.628507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:34.628507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:34.628507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:34.628507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:34.628507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:34.628507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:34.628507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:34.628507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:34.628507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:34.628507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:34.628507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:34.628507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:34.629313 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:34.629313 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:34.629313 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:34.629313 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:34.629313 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:34.629313 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:34.629313 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:34.629313 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:34.629313 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:34.629313 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:34.629313 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:12:34.629313 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:12:34.629313 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 172/348] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 16:12:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:34.633311 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934cb3b-1bf3-4f99-b668-be3230bd270a None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:34.633311 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934cb3b-1bf3-4f99-b668-be3230bd270a None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:34.633311 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934cb3b-1bf3-4f99-b668-be3230bd270a None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:34.634523 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 173/349] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:34.635275 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934cb3b-1bf3-4f99-b668-be3230bd270a None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:34.745896 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:34.775699 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2ad49-53db-4475-b66b-3318833b6011 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:34.790132 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934cb3b-1bf3-4f99-b668-be3230bd270a None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:34.820806 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e026e-0c45-44a5-8b29-470c079ac2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:34.821351 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e026e-0c45-44a5-8b29-470c079ac2f7 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:34.821630 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e026e-0c45-44a5-8b29-470c079ac2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:34.821903 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e026e-0c45-44a5-8b29-470c079ac2f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:34.822693 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e026e-0c45-44a5-8b29-470c079ac2f7 None admin] RBAC: Adding query filter params (role.id=b9b668e0b625469fa54fa2eb74cbdb97, user.id=63d74751e5524578b6916d9f65ffab89, scope.system=all) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:34.823003 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e026e-0c45-44a5-8b29-470c079ac2f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:34.824497 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e026e-0c45-44a5-8b29-470c079ac2f7 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:34.832212 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:34.839480 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 177/350] 10.222.0.65 () {56 vars in 1308 bytes} [Wed Jul 27 16:12:34 2022] GET /identity/v3/role_assignments?user.id=63d74751e5524578b6916d9f65ffab89&scope.system=all&role.id=b9b668e0b625469fa54fa2eb74cbdb97 => generated 510 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:34.840508 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac897ce-7809-404c-be09-87d22348c628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:34.841174 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c460f-7255-44eb-aca2-4393c01b15c2 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:34.841528 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c460f-7255-44eb-aca2-4393c01b15c2 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:34.841846 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac897ce-7809-404c-be09-87d22348c628 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:34.841964 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c460f-7255-44eb-aca2-4393c01b15c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:34.842461 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac897ce-7809-404c-be09-87d22348c628 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:34.843756 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac897ce-7809-404c-be09-87d22348c628 None admin] PATH_INFO: `/v3/groups/579f054055c34719b3b5aafe234e1b1b` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:34.852000 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac897ce-7809-404c-be09-87d22348c628 None admin] RBAC: Authorizing `identity:get_group(group_id=579f054055c34719b3b5aafe234e1b1b)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:34.854049 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac897ce-7809-404c-be09-87d22348c628 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:34.856412 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 174/351] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 16:12:34 2022] GET /identity/v3/groups/579f054055c34719b3b5aafe234e1b1b => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:34.857682 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac897ce-7809-404c-be09-87d22348c628 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:34.878412 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-980c460f-7255-44eb-aca2-4393c01b15c2 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:34.879650 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-980c460f-7255-44eb-aca2-4393c01b15c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:34.977465 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac897ce-7809-404c-be09-87d22348c628 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:34.997985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 178/352] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:34.998867 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c460f-7255-44eb-aca2-4393c01b15c2 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:35.016952 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc55d4-fba8-42d8-91fa-e238225ef7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:35.017981 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc55d4-fba8-42d8-91fa-e238225ef7dc None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:35.018464 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc55d4-fba8-42d8-91fa-e238225ef7dc None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:35.018967 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc55d4-fba8-42d8-91fa-e238225ef7dc None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:35.019928 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc55d4-fba8-42d8-91fa-e238225ef7dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:35.020485 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc55d4-fba8-42d8-91fa-e238225ef7dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:35.022418 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc55d4-fba8-42d8-91fa-e238225ef7dc None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:35.032650 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 175/353] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:12:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:35.038676 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc55d4-fba8-42d8-91fa-e238225ef7dc None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:35.102608 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:35.118377 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:35.145348 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c460f-7255-44eb-aca2-4393c01b15c2 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:35.180180 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc55d4-fba8-42d8-91fa-e238225ef7dc None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:35.188001 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74240787-d455-41c8-ac48-c1eb9719aab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:35.188952 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74240787-d455-41c8-ac48-c1eb9719aab6 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:35.188952 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74240787-d455-41c8-ac48-c1eb9719aab6 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:35.189230 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74240787-d455-41c8-ac48-c1eb9719aab6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:35.189965 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74240787-d455-41c8-ac48-c1eb9719aab6 None admin] RBAC: Adding query filter params (group.id=579f054055c34719b3b5aafe234e1b1b, role.id=5698bc4d332140e9af77ddcbb9915736, scope.project.id=8ac4a2d636fc4ebdb5fd8e84d1834c46) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:35.190274 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74240787-d455-41c8-ac48-c1eb9719aab6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:35.191876 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74240787-d455-41c8-ac48-c1eb9719aab6 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:35.199064 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 179/354] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Jul 27 16:12:34 2022] GET /identity/v3/role_assignments?group.id=579f054055c34719b3b5aafe234e1b1b&scope.project.id=8ac4a2d636fc4ebdb5fd8e84d1834c46&role.id=5698bc4d332140e9af77ddcbb9915736 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:35.199946 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74240787-d455-41c8-ac48-c1eb9719aab6 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:35.222839 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da50206-a90e-4a68-b081-78eb5cef7e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:35.223885 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da50206-a90e-4a68-b081-78eb5cef7e5c None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:35.224399 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da50206-a90e-4a68-b081-78eb5cef7e5c None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:35.224882 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da50206-a90e-4a68-b081-78eb5cef7e5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:35.319414 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da50206-a90e-4a68-b081-78eb5cef7e5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:35.321175 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da50206-a90e-4a68-b081-78eb5cef7e5c None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:35.353266 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74240787-d455-41c8-ac48-c1eb9719aab6 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:35.384759 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:35.391758 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:35.396157 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5253dc-a55a-4283-8119-2f69c9ab1149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:35.396849 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5253dc-a55a-4283-8119-2f69c9ab1149 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:35.397377 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5253dc-a55a-4283-8119-2f69c9ab1149 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:35.397744 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5253dc-a55a-4283-8119-2f69c9ab1149 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:35.413831 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5253dc-a55a-4283-8119-2f69c9ab1149 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:35.419523 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-7c5253dc-a55a-4283-8119-2f69c9ab1149 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:12:35.419523 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:35.419523 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:35.419523 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:35.419523 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:35.419523 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:35.419523 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:35.419523 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:35.419523 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:35.419523 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:35.419523 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:35.419523 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:35.419523 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:35.419523 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:35.419523 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:35.419523 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:35.420477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:35.420477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:35.420477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:35.420477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:35.420477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:35.420477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:35.420477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:35.420477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:35.420477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:35.420477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:35.420477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:35.420477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:35.420477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:35.420477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:35.420477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:35.420477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:35.421856 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:35.421856 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:35.421856 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:35.421856 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:35.421856 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:35.421856 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:35.421856 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:35.421856 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:35.421856 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:35.421856 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:35.421856 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:12:35.421856 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:35.421856 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 180/355] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:35.423341 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffdf53-d19d-41c8-ac2b-86fd759d3134 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:35.423341 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffdf53-d19d-41c8-ac2b-86fd759d3134 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:35.423631 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffdf53-d19d-41c8-ac2b-86fd759d3134 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:35.425782 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 181/356] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:35.432429 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753441bb-7292-4f67-af19-a1cf225a4142 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:35.433028 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753441bb-7292-4f67-af19-a1cf225a4142 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:35.433537 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753441bb-7292-4f67-af19-a1cf225a4142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:35.444551 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 176/357] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:12:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:12:35.445447 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da50206-a90e-4a68-b081-78eb5cef7e5c None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:35.458957 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-753441bb-7292-4f67-af19-a1cf225a4142 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:35.460668 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-753441bb-7292-4f67-af19-a1cf225a4142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:35.552651 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 182/358] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:35.554471 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753441bb-7292-4f67-af19-a1cf225a4142 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:35.595037 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da50206-a90e-4a68-b081-78eb5cef7e5c None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:35.634495 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff122e-0f86-4353-9522-1c815dac2ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:35.634686 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff122e-0f86-4353-9522-1c815dac2ae0 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:35.634905 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff122e-0f86-4353-9522-1c815dac2ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:35.635181 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff122e-0f86-4353-9522-1c815dac2ae0 None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:35.635942 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff122e-0f86-4353-9522-1c815dac2ae0 None admin] RBAC: Adding query filter params (name=member) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:35.636253 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff122e-0f86-4353-9522-1c815dac2ae0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:35.637627 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff122e-0f86-4353-9522-1c815dac2ae0 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:35.648978 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 177/359] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 16:12:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:35.655009 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a6dea-91ec-4c40-ab91-c0553631836a None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:35.655654 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a6dea-91ec-4c40-ab91-c0553631836a None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:35.656583 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a6dea-91ec-4c40-ab91-c0553631836a None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:35.658054 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 178/360] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:35.658903 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a6dea-91ec-4c40-ab91-c0553631836a None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:35.684959 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:35.717264 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753441bb-7292-4f67-af19-a1cf225a4142 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:35.757533 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:35.776899 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393ae1f-14da-4fea-90d6-cd6fcfc88915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:35.777947 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393ae1f-14da-4fea-90d6-cd6fcfc88915 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:35.778232 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393ae1f-14da-4fea-90d6-cd6fcfc88915 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:35.778510 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393ae1f-14da-4fea-90d6-cd6fcfc88915 None admin] PATH_INFO: `/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:35.779755 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393ae1f-14da-4fea-90d6-cd6fcfc88915 None admin] RBAC: Authorizing `identity:get_project(project_id=8ac4a2d636fc4ebdb5fd8e84d1834c46)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:35.782292 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393ae1f-14da-4fea-90d6-cd6fcfc88915 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:35.784307 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 183/361] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:35 2022] GET /identity/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:35.785209 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393ae1f-14da-4fea-90d6-cd6fcfc88915 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:35.800691 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a6dea-91ec-4c40-ab91-c0553631836a None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:35.853076 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd899e9-2898-4a33-bfce-d1ab6b4d1303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:35.853740 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd899e9-2898-4a33-bfce-d1ab6b4d1303 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:35.854027 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd899e9-2898-4a33-bfce-d1ab6b4d1303 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:35.854746 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd899e9-2898-4a33-bfce-d1ab6b4d1303 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:35.869547 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd899e9-2898-4a33-bfce-d1ab6b4d1303 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:35.877052 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-bdd899e9-2898-4a33-bfce-d1ab6b4d1303 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:12:35.877052 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:35.877052 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:35.877052 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:35.877052 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:35.877052 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:35.877052 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:35.877052 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:35.877052 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:35.877052 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:35.877052 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:35.877052 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:35.877052 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:35.877052 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:35.877052 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:35.877052 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:35.877970 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:35.877970 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:35.877970 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:35.877970 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:35.877970 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:35.877970 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:35.877970 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:35.877970 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:35.877970 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:35.877970 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:35.877970 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:35.877970 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:35.877970 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:35.877970 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:35.877970 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:35.877970 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:35.884074 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:35.884074 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:35.884074 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:35.884074 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:35.884074 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:35.884074 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:35.884074 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:35.884074 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:35.884074 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:35.884074 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:35.884074 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:12:35.884074 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:12:35.884074 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 179/362] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 16:12:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:35.884074 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9d7ff-5ba6-4907-bf70-b24c4594034a None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:35.884856 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9d7ff-5ba6-4907-bf70-b24c4594034a None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:35.884856 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9d7ff-5ba6-4907-bf70-b24c4594034a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:35.904392 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-f6d9d7ff-5ba6-4907-bf70-b24c4594034a None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:35.906223 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-f6d9d7ff-5ba6-4907-bf70-b24c4594034a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:35.926918 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393ae1f-14da-4fea-90d6-cd6fcfc88915 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:35.978994 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25310747-6398-44cb-a846-60842bccf2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:35.979922 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25310747-6398-44cb-a846-60842bccf2dc None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:35.980278 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25310747-6398-44cb-a846-60842bccf2dc None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:35.981458 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25310747-6398-44cb-a846-60842bccf2dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:36.007485 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 180/363] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:36.008562 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9d7ff-5ba6-4907-bf70-b24c4594034a None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:36.021742 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:36.070119 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:36.087193 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25310747-6398-44cb-a846-60842bccf2dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:36.088926 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25310747-6398-44cb-a846-60842bccf2dc None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:36.161352 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9d7ff-5ba6-4907-bf70-b24c4594034a None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:36.207155 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6390b-5fec-41db-b562-bdcea26f0bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:36.208104 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6390b-5fec-41db-b562-bdcea26f0bc5 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:36.208530 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6390b-5fec-41db-b562-bdcea26f0bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:36.208946 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6390b-5fec-41db-b562-bdcea26f0bc5 None admin] PATH_INFO: `/v3/groups/579f054055c34719b3b5aafe234e1b1b` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:36.210265 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6390b-5fec-41db-b562-bdcea26f0bc5 None admin] RBAC: Authorizing `identity:get_group(group_id=579f054055c34719b3b5aafe234e1b1b)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:36.211894 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6390b-5fec-41db-b562-bdcea26f0bc5 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:36.213650 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 181/364] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 16:12:36 2022] GET /identity/v3/groups/579f054055c34719b3b5aafe234e1b1b => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:36.214611 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6390b-5fec-41db-b562-bdcea26f0bc5 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:36.224025 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 184/365] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:12:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:12:36.225210 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25310747-6398-44cb-a846-60842bccf2dc None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:36.315048 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:36.338177 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:36.347768 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6390b-5fec-41db-b562-bdcea26f0bc5 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:36.350714 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25310747-6398-44cb-a846-60842bccf2dc None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:36.390943 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140dd694-cbc6-4801-be78-afc7d4bf3585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:36.391587 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140dd694-cbc6-4801-be78-afc7d4bf3585 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:36.391867 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140dd694-cbc6-4801-be78-afc7d4bf3585 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:36.392138 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140dd694-cbc6-4801-be78-afc7d4bf3585 None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:36.392853 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140dd694-cbc6-4801-be78-afc7d4bf3585 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:36.393151 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140dd694-cbc6-4801-be78-afc7d4bf3585 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:36.394529 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140dd694-cbc6-4801-be78-afc7d4bf3585 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:36.395450 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd679a4-07b9-4afc-b971-755a5f866b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:36.396318 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd679a4-07b9-4afc-b971-755a5f866b26 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:36.396810 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd679a4-07b9-4afc-b971-755a5f866b26 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:36.397161 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd679a4-07b9-4afc-b971-755a5f866b26 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:36.403348 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 182/366] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:36.404468 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140dd694-cbc6-4801-be78-afc7d4bf3585 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:36.418033 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd679a4-07b9-4afc-b971-755a5f866b26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:36.423326 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-7cd679a4-07b9-4afc-b971-755a5f866b26 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:12:36.423326 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:36.423326 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:36.423326 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:36.423326 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:36.423326 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:36.423326 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:36.423326 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:36.423326 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:36.423326 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:36.423326 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:36.423326 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:36.423326 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:36.423326 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:36.423326 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:36.423326 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:36.424428 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:36.424428 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:36.424428 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:36.424428 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:36.424428 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:36.424428 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:36.424428 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:36.424428 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:36.424428 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:36.424428 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:36.424428 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:36.424428 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:36.424428 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:36.424428 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:36.424428 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:36.424428 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:36.425375 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:36.425375 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:36.425375 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:36.425375 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:36.425375 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:36.425375 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:36.425375 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:36.425375 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:36.425375 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:36.425375 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:36.425375 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:12:36.425375 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:36.432213 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 185/367] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 16:12:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:36.433344 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd679a4-07b9-4afc-b971-755a5f866b26 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:36.535884 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140dd694-cbc6-4801-be78-afc7d4bf3585 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:36.585999 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea442e76-530e-49ea-806b-c868775392f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:36.586632 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea442e76-530e-49ea-806b-c868775392f3 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:36.586917 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea442e76-530e-49ea-806b-c868775392f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:36.587224 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea442e76-530e-49ea-806b-c868775392f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:36.588962 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea442e76-530e-49ea-806b-c868775392f3 None admin] RBAC: Adding query filter params (group.id=579f054055c34719b3b5aafe234e1b1b, role.id=cdb6d97b8d4a41e8aaec05181b77fada, scope.project.id=8ac4a2d636fc4ebdb5fd8e84d1834c46) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:36.588962 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea442e76-530e-49ea-806b-c868775392f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:36.589814 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea442e76-530e-49ea-806b-c868775392f3 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:36.595027 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd679a4-07b9-4afc-b971-755a5f866b26 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:36.601782 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 183/368] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Jul 27 16:12:36 2022] GET /identity/v3/role_assignments?group.id=579f054055c34719b3b5aafe234e1b1b&scope.project.id=8ac4a2d636fc4ebdb5fd8e84d1834c46&role.id=cdb6d97b8d4a41e8aaec05181b77fada => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:36.601782 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea442e76-530e-49ea-806b-c868775392f3 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:36.602255 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:36.640499 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802a49d-79f5-4569-ba33-d0eca73d46f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:36.641224 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802a49d-79f5-4569-ba33-d0eca73d46f8 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:36.641591 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802a49d-79f5-4569-ba33-d0eca73d46f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:36.641872 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802a49d-79f5-4569-ba33-d0eca73d46f8 None admin] PATH_INFO: `/v3/projects/bcb322d69d74445d9641596caf1b6a8e` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:36.643212 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802a49d-79f5-4569-ba33-d0eca73d46f8 None admin] RBAC: Authorizing `identity:get_project(project_id=bcb322d69d74445d9641596caf1b6a8e)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:36.645024 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802a49d-79f5-4569-ba33-d0eca73d46f8 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:36.646786 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 186/369] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:36 2022] GET /identity/v3/projects/bcb322d69d74445d9641596caf1b6a8e => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:36.647955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802a49d-79f5-4569-ba33-d0eca73d46f8 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:36.678281 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:36.742011 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea442e76-530e-49ea-806b-c868775392f3 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:36.786903 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd8e2c-c396-4c8c-bc87-a970d303b583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:36.787619 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd8e2c-c396-4c8c-bc87-a970d303b583 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:36.788892 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd8e2c-c396-4c8c-bc87-a970d303b583 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:36.789335 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd8e2c-c396-4c8c-bc87-a970d303b583 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:36.804355 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802a49d-79f5-4569-ba33-d0eca73d46f8 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:36.856786 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c12d4a-b3f8-4776-816c-5a4b782f20f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:36.858005 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c12d4a-b3f8-4776-816c-5a4b782f20f3 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:36.859590 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c12d4a-b3f8-4776-816c-5a4b782f20f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:36.860072 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c12d4a-b3f8-4776-816c-5a4b782f20f3 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:36.861100 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c12d4a-b3f8-4776-816c-5a4b782f20f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:36.862153 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c12d4a-b3f8-4776-816c-5a4b782f20f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:36.864079 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c12d4a-b3f8-4776-816c-5a4b782f20f3 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:36.876539 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 187/370] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:12:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:36.878361 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c12d4a-b3f8-4776-816c-5a4b782f20f3 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:36.888487 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd8e2c-c396-4c8c-bc87-a970d303b583 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:36.890029 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd8e2c-c396-4c8c-bc87-a970d303b583 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:36.898995 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:36.995096 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:37.016373 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c12d4a-b3f8-4776-816c-5a4b782f20f3 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:37.041788 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 184/371] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:12:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:12:37.043050 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd8e2c-c396-4c8c-bc87-a970d303b583 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:37.056591 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bf4e9-9856-4d6c-a42a-6b33fb0e7790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:37.057565 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bf4e9-9856-4d6c-a42a-6b33fb0e7790 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:37.057985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bf4e9-9856-4d6c-a42a-6b33fb0e7790 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:37.058406 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bf4e9-9856-4d6c-a42a-6b33fb0e7790 None admin] PATH_INFO: `/v3/groups/579f054055c34719b3b5aafe234e1b1b` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:37.059731 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bf4e9-9856-4d6c-a42a-6b33fb0e7790 None admin] RBAC: Authorizing `identity:get_group(group_id=579f054055c34719b3b5aafe234e1b1b)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:37.061324 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bf4e9-9856-4d6c-a42a-6b33fb0e7790 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:37.065838 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 188/372] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 16:12:36 2022] GET /identity/v3/groups/579f054055c34719b3b5aafe234e1b1b => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:37.072618 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bf4e9-9856-4d6c-a42a-6b33fb0e7790 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:37.173899 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd8e2c-c396-4c8c-bc87-a970d303b583 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:37.175815 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:37.198559 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bf4e9-9856-4d6c-a42a-6b33fb0e7790 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:37.228477 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb26f9-33e7-45fe-8ce8-c421ce0316f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:37.229499 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb26f9-33e7-45fe-8ce8-c421ce0316f3 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:37.230058 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb26f9-33e7-45fe-8ce8-c421ce0316f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:37.230552 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb26f9-33e7-45fe-8ce8-c421ce0316f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:37.240705 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b0391-bcb9-4ac1-a9c1-9d5f9aafcd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:37.241685 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b0391-bcb9-4ac1-a9c1-9d5f9aafcd73 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:37.242122 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b0391-bcb9-4ac1-a9c1-9d5f9aafcd73 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:37.242587 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b0391-bcb9-4ac1-a9c1-9d5f9aafcd73 None admin] PATH_INFO: `/v3/projects/4e89005d4d794906addd0b11c7e81008` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:37.243994 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b0391-bcb9-4ac1-a9c1-9d5f9aafcd73 None admin] RBAC: Authorizing `identity:get_project(project_id=4e89005d4d794906addd0b11c7e81008)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:37.245862 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b0391-bcb9-4ac1-a9c1-9d5f9aafcd73 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:37.248033 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 189/373] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:37 2022] GET /identity/v3/projects/4e89005d4d794906addd0b11c7e81008 => generated 344 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:37.249128 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b0391-bcb9-4ac1-a9c1-9d5f9aafcd73 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:37.276665 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:37.322146 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb26f9-33e7-45fe-8ce8-c421ce0316f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:37.323660 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb26f9-33e7-45fe-8ce8-c421ce0316f3 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:37.375982 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b0391-bcb9-4ac1-a9c1-9d5f9aafcd73 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:37.416127 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75dadc-c88c-4570-994e-fc310b9e315c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:37.417165 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75dadc-c88c-4570-994e-fc310b9e315c None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:37.417652 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75dadc-c88c-4570-994e-fc310b9e315c None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:37.418150 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75dadc-c88c-4570-994e-fc310b9e315c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:37.419278 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75dadc-c88c-4570-994e-fc310b9e315c None admin] RBAC: Adding query filter params (group.id=579f054055c34719b3b5aafe234e1b1b, role.id=5698bc4d332140e9af77ddcbb9915736, scope.project.id=bcb322d69d74445d9641596caf1b6a8e) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:37.419819 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75dadc-c88c-4570-994e-fc310b9e315c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:37.421560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75dadc-c88c-4570-994e-fc310b9e315c None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:37.428101 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 190/374] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Jul 27 16:12:37 2022] GET /identity/v3/role_assignments?group.id=579f054055c34719b3b5aafe234e1b1b&scope.project.id=bcb322d69d74445d9641596caf1b6a8e&role.id=5698bc4d332140e9af77ddcbb9915736 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:37.429362 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75dadc-c88c-4570-994e-fc310b9e315c None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:37.435403 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 185/375] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:12:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:12:37.438848 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb26f9-33e7-45fe-8ce8-c421ce0316f3 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:37.441058 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:37.556398 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb26f9-33e7-45fe-8ce8-c421ce0316f3 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:37.569466 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:37.596009 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75dadc-c88c-4570-994e-fc310b9e315c None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:37.597628 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7c9ab-913f-44b7-887b-974bb9a181e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:37.598644 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7c9ab-913f-44b7-887b-974bb9a181e1 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:37.598765 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7c9ab-913f-44b7-887b-974bb9a181e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:37.599094 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7c9ab-913f-44b7-887b-974bb9a181e1 None admin] PATH_INFO: `/v3/projects/bcb322d69d74445d9641596caf1b6a8e` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:37.601083 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7c9ab-913f-44b7-887b-974bb9a181e1 None admin] RBAC: Authorizing `identity:get_project(project_id=bcb322d69d74445d9641596caf1b6a8e)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:37.602362 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7c9ab-913f-44b7-887b-974bb9a181e1 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:37.604616 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 186/376] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:37 2022] GET /identity/v3/projects/bcb322d69d74445d9641596caf1b6a8e => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:37.611061 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7c9ab-913f-44b7-887b-974bb9a181e1 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:37.645651 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999c0fd-4bee-4bc5-8d7c-6a4eee91d8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:37.646697 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999c0fd-4bee-4bc5-8d7c-6a4eee91d8b9 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:37.647156 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999c0fd-4bee-4bc5-8d7c-6a4eee91d8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:37.647750 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999c0fd-4bee-4bc5-8d7c-6a4eee91d8b9 None admin] PATH_INFO: `/v3/groups/b411415c3de74a698dcc4406cfd0e5c1` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:37.656643 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999c0fd-4bee-4bc5-8d7c-6a4eee91d8b9 None admin] RBAC: Authorizing `identity:get_group(group_id=b411415c3de74a698dcc4406cfd0e5c1)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:37.658519 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999c0fd-4bee-4bc5-8d7c-6a4eee91d8b9 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:37.660926 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 191/377] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 16:12:37 2022] GET /identity/v3/groups/b411415c3de74a698dcc4406cfd0e5c1 => generated 229 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:37.677980 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999c0fd-4bee-4bc5-8d7c-6a4eee91d8b9 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:37.703609 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:37.744255 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7c9ab-913f-44b7-887b-974bb9a181e1 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:37.793968 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2269f0f-530d-4a60-89f2-1ca52805578a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:37.794825 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2269f0f-530d-4a60-89f2-1ca52805578a None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:37.795190 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2269f0f-530d-4a60-89f2-1ca52805578a None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:37.795588 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2269f0f-530d-4a60-89f2-1ca52805578a None admin] PATH_INFO: `/v3/groups/579f054055c34719b3b5aafe234e1b1b` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:37.797724 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2269f0f-530d-4a60-89f2-1ca52805578a None admin] RBAC: Authorizing `identity:get_group(group_id=579f054055c34719b3b5aafe234e1b1b)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:37.799279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2269f0f-530d-4a60-89f2-1ca52805578a None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:37.801331 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 187/378] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 16:12:37 2022] GET /identity/v3/groups/579f054055c34719b3b5aafe234e1b1b => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:37.808001 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2269f0f-530d-4a60-89f2-1ca52805578a None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:37.831736 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999c0fd-4bee-4bc5-8d7c-6a4eee91d8b9 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:37.875890 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a09f5-2320-4a61-b2a4-204fcb624c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:37.876530 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a09f5-2320-4a61-b2a4-204fcb624c43 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:37.877073 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a09f5-2320-4a61-b2a4-204fcb624c43 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:37.877363 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a09f5-2320-4a61-b2a4-204fcb624c43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:37.878650 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a09f5-2320-4a61-b2a4-204fcb624c43 None admin] RBAC: Adding query filter params (group.id=b411415c3de74a698dcc4406cfd0e5c1, role.id=76e01abae9964dd5b28fc8895f739ee4, scope.project.id=4e89005d4d794906addd0b11c7e81008) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:37.878975 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a09f5-2320-4a61-b2a4-204fcb624c43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:37.880772 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a09f5-2320-4a61-b2a4-204fcb624c43 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:37.888558 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 192/379] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Jul 27 16:12:37 2022] GET /identity/v3/role_assignments?group.id=b411415c3de74a698dcc4406cfd0e5c1&scope.project.id=4e89005d4d794906addd0b11c7e81008&role.id=76e01abae9964dd5b28fc8895f739ee4 => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:37.890308 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1594720-31c4-49e5-89d2-7d885f5e0f67 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:37.890656 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1594720-31c4-49e5-89d2-7d885f5e0f67 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:37.890947 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1594720-31c4-49e5-89d2-7d885f5e0f67 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:37.892310 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 193/380] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:37.899124 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fee07-d83c-4a95-8c2a-f6049e17b986 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:37.899743 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fee07-d83c-4a95-8c2a-f6049e17b986 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:37.900107 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fee07-d83c-4a95-8c2a-f6049e17b986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:37.924604 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-777fee07-d83c-4a95-8c2a-f6049e17b986 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:37.926065 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-777fee07-d83c-4a95-8c2a-f6049e17b986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:37.928731 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:37.980094 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2269f0f-530d-4a60-89f2-1ca52805578a None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:38.018108 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 194/381] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:12:38.045703 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777fee07-d83c-4a95-8c2a-f6049e17b986 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:38.060349 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db08a35-9ad0-4418-a7b1-db02337cbe49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:38.061203 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db08a35-9ad0-4418-a7b1-db02337cbe49 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:38.063968 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db08a35-9ad0-4418-a7b1-db02337cbe49 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:38.064476 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db08a35-9ad0-4418-a7b1-db02337cbe49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:38.065723 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db08a35-9ad0-4418-a7b1-db02337cbe49 None admin] RBAC: Adding query filter params (group.id=579f054055c34719b3b5aafe234e1b1b, role.id=cdb6d97b8d4a41e8aaec05181b77fada, scope.project.id=bcb322d69d74445d9641596caf1b6a8e) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:38.066052 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db08a35-9ad0-4418-a7b1-db02337cbe49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:38.068165 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db08a35-9ad0-4418-a7b1-db02337cbe49 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:38.086362 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 188/382] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Jul 27 16:12:37 2022] GET /identity/v3/role_assignments?group.id=579f054055c34719b3b5aafe234e1b1b&scope.project.id=bcb322d69d74445d9641596caf1b6a8e&role.id=cdb6d97b8d4a41e8aaec05181b77fada => generated 260 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:38.202112 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777fee07-d83c-4a95-8c2a-f6049e17b986 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:38.247941 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10133c73-59f2-4fb3-b169-bc23b3bf77df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:38.248611 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10133c73-59f2-4fb3-b169-bc23b3bf77df None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:38.248904 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10133c73-59f2-4fb3-b169-bc23b3bf77df None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:38.249184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10133c73-59f2-4fb3-b169-bc23b3bf77df None admin] PATH_INFO: `/v3/roles/member` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:38.257608 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:38.262864 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10133c73-59f2-4fb3-b169-bc23b3bf77df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:38.271319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-10133c73-59f2-4fb3-b169-bc23b3bf77df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:12:38.271319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:38.271319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:38.271319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:38.271319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:38.271319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:38.271319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:38.271319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:38.271319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:38.271319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:38.271319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:38.271319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:38.271319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:38.271319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:38.271319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:38.271319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:38.272292 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:38.272292 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:38.272292 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:38.272292 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:38.272292 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:38.272292 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:38.272292 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:38.272292 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:38.272292 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:38.272292 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:38.272292 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:38.272292 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:38.272292 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:38.272292 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:38.272292 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:38.272292 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:38.273068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:38.273068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:38.273068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:38.273068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:38.273068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:38.273068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:38.273068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:38.273068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:38.273068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:38.273068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:38.273068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:12:38.273068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:38.276313 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 195/383] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:12:38.282807 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db08a35-9ad0-4418-a7b1-db02337cbe49 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:38.285786 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:38.408098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db08a35-9ad0-4418-a7b1-db02337cbe49 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:38.446567 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf406b8-752d-45f7-9fec-66b8ac1bbb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:38.447211 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf406b8-752d-45f7-9fec-66b8ac1bbb5e None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:38.447545 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf406b8-752d-45f7-9fec-66b8ac1bbb5e None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:38.447824 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf406b8-752d-45f7-9fec-66b8ac1bbb5e None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:38.448554 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf406b8-752d-45f7-9fec-66b8ac1bbb5e None admin] RBAC: Adding query filter params (name=member) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:38.448866 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf406b8-752d-45f7-9fec-66b8ac1bbb5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:38.450261 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf406b8-752d-45f7-9fec-66b8ac1bbb5e None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:38.462256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 189/384] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 16:12:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:38.467915 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10133c73-59f2-4fb3-b169-bc23b3bf77df None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:38.584174 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10133c73-59f2-4fb3-b169-bc23b3bf77df None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:38.622737 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1862a-f7cd-477e-8395-5d17990395c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:38.623412 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1862a-f7cd-477e-8395-5d17990395c3 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:38.623706 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1862a-f7cd-477e-8395-5d17990395c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:38.623988 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1862a-f7cd-477e-8395-5d17990395c3 None admin] PATH_INFO: `/v3/groups/579f054055c34719b3b5aafe234e1b1b` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:38.625196 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1862a-f7cd-477e-8395-5d17990395c3 None admin] RBAC: Authorizing `identity:get_group(group_id=579f054055c34719b3b5aafe234e1b1b)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:38.626645 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1862a-f7cd-477e-8395-5d17990395c3 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:38.628317 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 196/385] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 16:12:38 2022] GET /identity/v3/groups/579f054055c34719b3b5aafe234e1b1b => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:38.634090 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf406b8-752d-45f7-9fec-66b8ac1bbb5e None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:38.728257 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:38.776438 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf406b8-752d-45f7-9fec-66b8ac1bbb5e None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:38.820287 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd41973-4cd1-4aa4-8733-0c7b9b9e178e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:38.820954 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd41973-4cd1-4aa4-8733-0c7b9b9e178e None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:38.821241 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd41973-4cd1-4aa4-8733-0c7b9b9e178e None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:38.821521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd41973-4cd1-4aa4-8733-0c7b9b9e178e None admin] PATH_INFO: `/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:38.822692 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd41973-4cd1-4aa4-8733-0c7b9b9e178e None admin] RBAC: Authorizing `identity:get_project(project_id=8ac4a2d636fc4ebdb5fd8e84d1834c46)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:38.824248 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd41973-4cd1-4aa4-8733-0c7b9b9e178e None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:38.826360 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 190/386] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:38 2022] GET /identity/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:38.832632 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1862a-f7cd-477e-8395-5d17990395c3 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:38.914633 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:38.956852 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1862a-f7cd-477e-8395-5d17990395c3 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:39.004083 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0fa64-a6fd-45b8-a3ca-dda39ec2acdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:39.004778 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0fa64-a6fd-45b8-a3ca-dda39ec2acdd None admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:39.005063 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0fa64-a6fd-45b8-a3ca-dda39ec2acdd None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:39.005343 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0fa64-a6fd-45b8-a3ca-dda39ec2acdd None admin] PATH_INFO: `/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46/groups/579f054055c34719b3b5aafe234e1b1b/roles/5698bc4d332140e9af77ddcbb9915736` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:39.007345 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0fa64-a6fd-45b8-a3ca-dda39ec2acdd None admin] RBAC: Authorizing `identity:create_grant(project_id=8ac4a2d636fc4ebdb5fd8e84d1834c46, group_id=579f054055c34719b3b5aafe234e1b1b, role_id=5698bc4d332140e9af77ddcbb9915736)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:39.008843 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0fa64-a6fd-45b8-a3ca-dda39ec2acdd None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:39.034791 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 197/387] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Jul 27 16:12:38 2022] PUT /identity/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46/groups/579f054055c34719b3b5aafe234e1b1b/roles/5698bc4d332140e9af77ddcbb9915736 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:12:39.450352 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfca974-12b6-4455-80aa-640fb9cea785 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:39.450352 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfca974-12b6-4455-80aa-640fb9cea785 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:39.450352 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfca974-12b6-4455-80aa-640fb9cea785 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:39.451470 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 191/388] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:39.457780 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f19c24-fcb6-4967-9b66-c70e0e76e803 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:39.458250 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f19c24-fcb6-4967-9b66-c70e0e76e803 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:39.458333 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f19c24-fcb6-4967-9b66-c70e0e76e803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:39.483228 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-48f19c24-fcb6-4967-9b66-c70e0e76e803 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:39.485075 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-48f19c24-fcb6-4967-9b66-c70e0e76e803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:39.575172 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 198/389] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:39.621327 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfca974-12b6-4455-80aa-640fb9cea785 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:39.761679 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfca974-12b6-4455-80aa-640fb9cea785 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:39.795762 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:39.801612 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390f923-7f6a-4751-a05f-e7c8a3ea0826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:39.802274 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390f923-7f6a-4751-a05f-e7c8a3ea0826 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:39.802562 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390f923-7f6a-4751-a05f-e7c8a3ea0826 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:39.802841 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390f923-7f6a-4751-a05f-e7c8a3ea0826 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:39.814428 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b390f923-7f6a-4751-a05f-e7c8a3ea0826 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:39.819942 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-b390f923-7f6a-4751-a05f-e7c8a3ea0826 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:12:39.819942 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:39.819942 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:39.819942 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:39.819942 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:39.819942 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:39.819942 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:39.819942 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:39.819942 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:39.819942 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:39.819942 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:39.819942 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:39.819942 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:39.819942 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:39.819942 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:39.819942 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:39.820873 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:39.820873 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:39.820873 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:39.820873 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:39.820873 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:39.820873 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:39.820873 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:39.820873 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:39.820873 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:39.820873 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:39.820873 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:39.820873 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:39.820873 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:39.820873 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:39.820873 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:39.820873 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:39.821639 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:39.821639 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:39.821639 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:39.821639 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:39.821639 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:39.821639 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:39.821639 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:39.821639 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:39.821639 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:39.821639 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:39.821639 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:12:39.821639 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:12:39.825897 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 192/390] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 16:12:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:39.830846 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f19c24-fcb6-4967-9b66-c70e0e76e803 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:39.979755 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:39.996700 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f19c24-fcb6-4967-9b66-c70e0e76e803 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:40.035283 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ac5a2-6f2b-4417-ae0b-b204eba7fabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:40.036187 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ac5a2-6f2b-4417-ae0b-b204eba7fabf None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:40.036621 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ac5a2-6f2b-4417-ae0b-b204eba7fabf None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:40.037042 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ac5a2-6f2b-4417-ae0b-b204eba7fabf None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:40.038224 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ac5a2-6f2b-4417-ae0b-b204eba7fabf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:40.038704 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ac5a2-6f2b-4417-ae0b-b204eba7fabf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:40.040263 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ac5a2-6f2b-4417-ae0b-b204eba7fabf None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:40.050014 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 199/391] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:12:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:40.055426 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390f923-7f6a-4751-a05f-e7c8a3ea0826 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:40.206791 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390f923-7f6a-4751-a05f-e7c8a3ea0826 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:40.258872 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235af06-06a2-4c34-be27-cd3ec8d371ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:40.259549 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235af06-06a2-4c34-be27-cd3ec8d371ba None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:40.259833 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235af06-06a2-4c34-be27-cd3ec8d371ba None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:40.260109 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235af06-06a2-4c34-be27-cd3ec8d371ba None admin] PATH_INFO: `/v3/groups/579f054055c34719b3b5aafe234e1b1b` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:40.264094 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235af06-06a2-4c34-be27-cd3ec8d371ba None admin] RBAC: Authorizing `identity:get_group(group_id=579f054055c34719b3b5aafe234e1b1b)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:40.266074 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235af06-06a2-4c34-be27-cd3ec8d371ba None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:40.267733 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 193/392] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 16:12:40 2022] GET /identity/v3/groups/579f054055c34719b3b5aafe234e1b1b => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:40.273537 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ac5a2-6f2b-4417-ae0b-b204eba7fabf None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:40.399763 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ac5a2-6f2b-4417-ae0b-b204eba7fabf None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:40.418983 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:40.447903 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99d434-e8af-4cbc-add6-ffd1ed27107d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:40.449016 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99d434-e8af-4cbc-add6-ffd1ed27107d None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:40.449590 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99d434-e8af-4cbc-add6-ffd1ed27107d None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:40.450028 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99d434-e8af-4cbc-add6-ffd1ed27107d None admin] PATH_INFO: `/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:40.451508 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99d434-e8af-4cbc-add6-ffd1ed27107d None admin] RBAC: Authorizing `identity:get_project(project_id=8ac4a2d636fc4ebdb5fd8e84d1834c46)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:40.453557 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99d434-e8af-4cbc-add6-ffd1ed27107d None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:40.455582 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 200/393] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:40 2022] GET /identity/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:40.461172 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235af06-06a2-4c34-be27-cd3ec8d371ba None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:40.566439 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:40.623625 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235af06-06a2-4c34-be27-cd3ec8d371ba None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:40.674282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0729640-6235-48b3-8297-8e5510f7f2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:40.674989 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0729640-6235-48b3-8297-8e5510f7f2da None admin] REQUEST_METHOD: `PUT` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:40.675269 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0729640-6235-48b3-8297-8e5510f7f2da None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:40.675575 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0729640-6235-48b3-8297-8e5510f7f2da None admin] PATH_INFO: `/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46/groups/579f054055c34719b3b5aafe234e1b1b/roles/cdb6d97b8d4a41e8aaec05181b77fada` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:40.680906 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0729640-6235-48b3-8297-8e5510f7f2da None admin] RBAC: Authorizing `identity:create_grant(project_id=8ac4a2d636fc4ebdb5fd8e84d1834c46, group_id=579f054055c34719b3b5aafe234e1b1b, role_id=cdb6d97b8d4a41e8aaec05181b77fada)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:40.682383 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0729640-6235-48b3-8297-8e5510f7f2da None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:40.706728 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 194/394] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Jul 27 16:12:40 2022] PUT /identity/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46/groups/579f054055c34719b3b5aafe234e1b1b/roles/cdb6d97b8d4a41e8aaec05181b77fada => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:12:40.825982 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed90c7-f978-42d4-ac30-52a847b0d157 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:40.826580 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed90c7-f978-42d4-ac30-52a847b0d157 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:40.826580 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed90c7-f978-42d4-ac30-52a847b0d157 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:40.828528 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 201/395] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:40.835220 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe235a1-b74e-40cf-9eb5-76e32cb79cf4 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:40.835220 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe235a1-b74e-40cf-9eb5-76e32cb79cf4 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:40.835220 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe235a1-b74e-40cf-9eb5-76e32cb79cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:40.872528 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-8fe235a1-b74e-40cf-9eb5-76e32cb79cf4 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:40.873744 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-8fe235a1-b74e-40cf-9eb5-76e32cb79cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:40.974307 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 195/396] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:12:40.999622 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed90c7-f978-42d4-ac30-52a847b0d157 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:41.006173 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5a703-e220-4cb9-b53a-14d24a611f26 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:41.006482 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5a703-e220-4cb9-b53a-14d24a611f26 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:41.006771 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5a703-e220-4cb9-b53a-14d24a611f26 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:41.008559 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 196/397] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:41.013897 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf681afc-0a6e-4332-abf6-692eb74886e4 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:41.014192 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf681afc-0a6e-4332-abf6-692eb74886e4 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:41.015466 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf681afc-0a6e-4332-abf6-692eb74886e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:41.044803 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-bf681afc-0a6e-4332-abf6-692eb74886e4 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:41.046004 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-bf681afc-0a6e-4332-abf6-692eb74886e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:41.121885 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:41.163958 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 197/398] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:12:41.188122 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed90c7-f978-42d4-ac30-52a847b0d157 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:41.210273 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf681afc-0a6e-4332-abf6-692eb74886e4 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:41.259880 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ff0a4-af6a-4f76-9df7-4aac0ebddab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:41.261127 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ff0a4-af6a-4f76-9df7-4aac0ebddab8 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:41.262012 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ff0a4-af6a-4f76-9df7-4aac0ebddab8 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:41.262747 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ff0a4-af6a-4f76-9df7-4aac0ebddab8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:41.277385 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ff0a4-af6a-4f76-9df7-4aac0ebddab8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:41.286165 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-f81ff0a4-af6a-4f76-9df7-4aac0ebddab8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:12:41.286165 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:41.286165 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:41.286165 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:41.286165 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:41.286165 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:41.286165 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:41.286165 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:41.286165 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:41.286165 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:41.286165 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:41.286165 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:41.286165 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:41.286165 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:41.286165 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:41.286165 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:41.287058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:41.287058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:41.287058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:41.287058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:41.287058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:41.287058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:41.287058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:41.287058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:41.287058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:41.287058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:41.287058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:41.287058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:41.287058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:41.287058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:41.287058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:41.287058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:41.287936 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:41.287936 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:41.287936 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:41.287936 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:41.287936 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:41.287936 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:41.287936 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:41.287936 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:41.287936 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:41.287936 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:41.287936 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:12:41.287936 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:41.289361 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 202/399] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 16:12:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:41.291367 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c653f-4b11-47ac-a77f-d1f1a633591d None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:41.291675 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c653f-4b11-47ac-a77f-d1f1a633591d None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:41.291941 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c653f-4b11-47ac-a77f-d1f1a633591d None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:41.293344 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 203/400] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:41.298639 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c653f-4b11-47ac-a77f-d1f1a633591d None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:41.329550 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf681afc-0a6e-4332-abf6-692eb74886e4 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:41.366731 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6449c20-3221-446e-a06e-bc6ab62678ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:41.367461 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6449c20-3221-446e-a06e-bc6ab62678ce None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:41.367747 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6449c20-3221-446e-a06e-bc6ab62678ce None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:41.368075 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6449c20-3221-446e-a06e-bc6ab62678ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:41.371882 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:41.381751 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6449c20-3221-446e-a06e-bc6ab62678ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:41.386969 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-b6449c20-3221-446e-a06e-bc6ab62678ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:12:41.386969 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:41.386969 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:41.386969 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:41.386969 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:41.386969 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:41.386969 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:41.386969 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:41.386969 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:41.386969 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:41.386969 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:41.386969 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:41.386969 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:41.386969 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:41.386969 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:41.386969 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:41.387928 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:41.387928 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:41.387928 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:41.387928 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:41.387928 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:41.387928 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:41.387928 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:41.387928 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:41.387928 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:41.387928 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:41.387928 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:41.387928 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:41.387928 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:41.387928 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:41.387928 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:41.387928 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:41.388693 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:41.388693 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:41.388693 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:41.388693 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:41.388693 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:41.388693 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:41.388693 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:41.388693 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:41.388693 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:41.388693 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:41.388693 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:12:41.388693 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:12:41.393545 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 198/401] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:12:41.395177 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a7fcb-2581-4928-a676-ee8a10e0737a None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:41.395354 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a7fcb-2581-4928-a676-ee8a10e0737a None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:41.395660 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a7fcb-2581-4928-a676-ee8a10e0737a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:41.417160 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-5e0a7fcb-2581-4928-a676-ee8a10e0737a None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:41.418355 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-5e0a7fcb-2581-4928-a676-ee8a10e0737a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:41.447572 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c653f-4b11-47ac-a77f-d1f1a633591d None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:41.470843 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:41.486639 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64895b90-6a4a-42ab-ac4b-a157cf8237d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:41.487465 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64895b90-6a4a-42ab-ac4b-a157cf8237d0 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:41.487852 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64895b90-6a4a-42ab-ac4b-a157cf8237d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:41.488230 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64895b90-6a4a-42ab-ac4b-a157cf8237d0 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:41.489051 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64895b90-6a4a-42ab-ac4b-a157cf8237d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:41.489499 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64895b90-6a4a-42ab-ac4b-a157cf8237d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:41.491013 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64895b90-6a4a-42ab-ac4b-a157cf8237d0 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:41.500729 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 204/402] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:41.501837 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64895b90-6a4a-42ab-ac4b-a157cf8237d0 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:41.513878 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 199/403] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:41.515428 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a7fcb-2581-4928-a676-ee8a10e0737a None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:41.618103 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64895b90-6a4a-42ab-ac4b-a157cf8237d0 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:41.628250 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:41.648759 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a7fcb-2581-4928-a676-ee8a10e0737a None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:41.657900 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03a3ec-0282-4ecd-a105-e543b4ca291f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:41.658707 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03a3ec-0282-4ecd-a105-e543b4ca291f None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:41.659059 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03a3ec-0282-4ecd-a105-e543b4ca291f None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:41.659461 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03a3ec-0282-4ecd-a105-e543b4ca291f None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:41.660282 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f03a3ec-0282-4ecd-a105-e543b4ca291f None admin] RBAC: Adding query filter params (name=member) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:41.660712 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f03a3ec-0282-4ecd-a105-e543b4ca291f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:41.662208 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f03a3ec-0282-4ecd-a105-e543b4ca291f None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:41.679559 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 205/404] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 16:12:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:41.680671 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03a3ec-0282-4ecd-a105-e543b4ca291f None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:41.693010 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7c302-8a18-4ea1-8a0d-4ee7d7bd9240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:41.694301 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7c302-8a18-4ea1-8a0d-4ee7d7bd9240 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:41.694729 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7c302-8a18-4ea1-8a0d-4ee7d7bd9240 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:41.695171 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7c302-8a18-4ea1-8a0d-4ee7d7bd9240 None admin] PATH_INFO: `/v3/groups/b411415c3de74a698dcc4406cfd0e5c1` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:41.697722 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7c302-8a18-4ea1-8a0d-4ee7d7bd9240 None admin] RBAC: Authorizing `identity:get_group(group_id=b411415c3de74a698dcc4406cfd0e5c1)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:41.699213 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7c302-8a18-4ea1-8a0d-4ee7d7bd9240 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:41.700889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 200/405] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 16:12:41 2022] GET /identity/v3/groups/b411415c3de74a698dcc4406cfd0e5c1 => generated 229 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:41.703492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7c302-8a18-4ea1-8a0d-4ee7d7bd9240 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:41.746589 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:41.819137 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03a3ec-0282-4ecd-a105-e543b4ca291f None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:41.822980 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7c302-8a18-4ea1-8a0d-4ee7d7bd9240 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:41.856797 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0763a1-af47-410c-9286-8d95dce7faa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:41.857361 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0763a1-af47-410c-9286-8d95dce7faa8 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:41.857633 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0763a1-af47-410c-9286-8d95dce7faa8 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:41.857923 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0763a1-af47-410c-9286-8d95dce7faa8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:41.862983 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b641c-6c1d-4c07-b6d5-c426bfef97db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:41.864053 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b641c-6c1d-4c07-b6d5-c426bfef97db None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:41.864537 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b641c-6c1d-4c07-b6d5-c426bfef97db None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:41.865030 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b641c-6c1d-4c07-b6d5-c426bfef97db None admin] PATH_INFO: `/v3/groups/579f054055c34719b3b5aafe234e1b1b` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:41.866559 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b641c-6c1d-4c07-b6d5-c426bfef97db None admin] RBAC: Authorizing `identity:get_group(group_id=579f054055c34719b3b5aafe234e1b1b)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:41.868431 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b641c-6c1d-4c07-b6d5-c426bfef97db None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:41.870678 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 201/406] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 16:12:41 2022] GET /identity/v3/groups/579f054055c34719b3b5aafe234e1b1b => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:41.871842 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b641c-6c1d-4c07-b6d5-c426bfef97db None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:41.875294 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0763a1-af47-410c-9286-8d95dce7faa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:41.881602 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-3e0763a1-af47-410c-9286-8d95dce7faa8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:12:41.881602 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:41.881602 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:41.881602 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:41.881602 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:41.881602 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:41.881602 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:41.881602 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:41.881602 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:41.881602 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:41.881602 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:41.881602 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:41.881602 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:41.881602 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:41.881602 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:41.881602 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:41.882616 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:41.882616 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:41.882616 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:41.882616 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:41.882616 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:41.882616 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:41.882616 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:41.882616 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:41.882616 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:41.882616 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:41.882616 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:41.882616 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:41.882616 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:41.882616 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:41.882616 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:41.882616 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:41.883443 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:41.883443 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:41.883443 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:41.883443 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:41.883443 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:41.883443 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:41.883443 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:41.883443 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:41.883443 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:41.883443 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:41.883443 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:12:41.883443 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:41.883443 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 206/407] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 16:12:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:41.884811 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0763a1-af47-410c-9286-8d95dce7faa8 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:41.918812 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:41.988066 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b641c-6c1d-4c07-b6d5-c426bfef97db None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:41.995774 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:41.996936 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0763a1-af47-410c-9286-8d95dce7faa8 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:42.026718 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb91387-5813-4f76-bad3-327f15cb1c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:42.027412 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb91387-5813-4f76-bad3-327f15cb1c71 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:42.027709 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb91387-5813-4f76-bad3-327f15cb1c71 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:42.027986 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb91387-5813-4f76-bad3-327f15cb1c71 None admin] PATH_INFO: `/v3/projects/4e89005d4d794906addd0b11c7e81008` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:42.029171 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb91387-5813-4f76-bad3-327f15cb1c71 None admin] RBAC: Authorizing `identity:get_project(project_id=4e89005d4d794906addd0b11c7e81008)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:42.031206 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb91387-5813-4f76-bad3-327f15cb1c71 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:42.033064 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 202/408] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:41 2022] GET /identity/v3/projects/4e89005d4d794906addd0b11c7e81008 => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:42.035493 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb91387-5813-4f76-bad3-327f15cb1c71 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:42.039733 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ab465-939f-4ea8-851d-162da39da563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:42.040391 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ab465-939f-4ea8-851d-162da39da563 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:42.040683 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ab465-939f-4ea8-851d-162da39da563 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:42.040964 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ab465-939f-4ea8-851d-162da39da563 None admin] PATH_INFO: `/v3/projects/bcb322d69d74445d9641596caf1b6a8e` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:42.042153 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ab465-939f-4ea8-851d-162da39da563 None admin] RBAC: Authorizing `identity:get_project(project_id=bcb322d69d74445d9641596caf1b6a8e)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:42.043627 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ab465-939f-4ea8-851d-162da39da563 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:42.045284 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 207/409] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:41 2022] GET /identity/v3/projects/bcb322d69d74445d9641596caf1b6a8e => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:42.046540 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a56b12-7c10-4401-8579-513f15b54e31 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:42.046831 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a56b12-7c10-4401-8579-513f15b54e31 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:42.047112 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a56b12-7c10-4401-8579-513f15b54e31 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:42.048599 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 208/410] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:42.049304 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a56b12-7c10-4401-8579-513f15b54e31 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:42.156515 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb91387-5813-4f76-bad3-327f15cb1c71 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:42.162073 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:42.168156 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a56b12-7c10-4401-8579-513f15b54e31 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:42.194448 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e04ae-54d0-4e62-948f-203a8bb03db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:42.195321 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e04ae-54d0-4e62-948f-203a8bb03db6 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:42.195641 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e04ae-54d0-4e62-948f-203a8bb03db6 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:42.195958 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e04ae-54d0-4e62-948f-203a8bb03db6 None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:42.196627 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e04ae-54d0-4e62-948f-203a8bb03db6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:42.197092 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e04ae-54d0-4e62-948f-203a8bb03db6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:42.198312 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e04ae-54d0-4e62-948f-203a8bb03db6 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:42.205319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada8597-96c1-43de-bf0f-78fbc78ddde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:42.205990 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada8597-96c1-43de-bf0f-78fbc78ddde1 None admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:42.206274 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada8597-96c1-43de-bf0f-78fbc78ddde1 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:42.206551 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada8597-96c1-43de-bf0f-78fbc78ddde1 None admin] PATH_INFO: `/v3/projects/4e89005d4d794906addd0b11c7e81008/groups/b411415c3de74a698dcc4406cfd0e5c1/roles/76e01abae9964dd5b28fc8895f739ee4` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:42.207942 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 203/411] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:12:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:42.208665 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada8597-96c1-43de-bf0f-78fbc78ddde1 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e89005d4d794906addd0b11c7e81008, group_id=b411415c3de74a698dcc4406cfd0e5c1, role_id=76e01abae9964dd5b28fc8895f739ee4)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:42.210263 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada8597-96c1-43de-bf0f-78fbc78ddde1 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:42.213614 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a534e2-bcc5-41ee-b6b0-31033d4696bb None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:42.213748 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a534e2-bcc5-41ee-b6b0-31033d4696bb None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:42.214162 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a534e2-bcc5-41ee-b6b0-31033d4696bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:42.225701 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 209/412] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Jul 27 16:12:42 2022] PUT /identity/v3/projects/4e89005d4d794906addd0b11c7e81008/groups/b411415c3de74a698dcc4406cfd0e5c1/roles/76e01abae9964dd5b28fc8895f739ee4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:12:42.234466 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-75a534e2-bcc5-41ee-b6b0-31033d4696bb None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:42.235786 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-75a534e2-bcc5-41ee-b6b0-31033d4696bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:42.236314 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada8597-96c1-43de-bf0f-78fbc78ddde1 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:42.279714 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:42.346347 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 204/413] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:42.347288 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a534e2-bcc5-41ee-b6b0-31033d4696bb None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:42.383618 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada8597-96c1-43de-bf0f-78fbc78ddde1 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:42.424465 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12814f8-d51a-443d-af6b-d1193c1f400d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:42.425067 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12814f8-d51a-443d-af6b-d1193c1f400d None admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:42.425357 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12814f8-d51a-443d-af6b-d1193c1f400d None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:42.425644 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12814f8-d51a-443d-af6b-d1193c1f400d None admin] PATH_INFO: `/v3/projects/bcb322d69d74445d9641596caf1b6a8e/groups/579f054055c34719b3b5aafe234e1b1b/roles/5698bc4d332140e9af77ddcbb9915736` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:42.427625 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12814f8-d51a-443d-af6b-d1193c1f400d None admin] RBAC: Authorizing `identity:create_grant(project_id=bcb322d69d74445d9641596caf1b6a8e, group_id=579f054055c34719b3b5aafe234e1b1b, role_id=5698bc4d332140e9af77ddcbb9915736)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:42.429081 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12814f8-d51a-443d-af6b-d1193c1f400d None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:42.449416 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 210/414] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Jul 27 16:12:42 2022] PUT /identity/v3/projects/bcb322d69d74445d9641596caf1b6a8e/groups/579f054055c34719b3b5aafe234e1b1b/roles/5698bc4d332140e9af77ddcbb9915736 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:12:42.449416 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12814f8-d51a-443d-af6b-d1193c1f400d None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:42.486296 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:42.497495 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a534e2-bcc5-41ee-b6b0-31033d4696bb None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:42.566678 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df5897-dd7b-4998-a026-cf9200dd7590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:42.568520 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df5897-dd7b-4998-a026-cf9200dd7590 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:42.569152 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df5897-dd7b-4998-a026-cf9200dd7590 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:42.570218 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df5897-dd7b-4998-a026-cf9200dd7590 None admin] PATH_INFO: `/v3/groups/579f054055c34719b3b5aafe234e1b1b` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:42.573174 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df5897-dd7b-4998-a026-cf9200dd7590 None admin] RBAC: Authorizing `identity:get_group(group_id=579f054055c34719b3b5aafe234e1b1b)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:42.574845 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df5897-dd7b-4998-a026-cf9200dd7590 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:42.576982 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 205/415] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 16:12:42 2022] GET /identity/v3/groups/579f054055c34719b3b5aafe234e1b1b => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:42.583340 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df5897-dd7b-4998-a026-cf9200dd7590 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:42.642633 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:42.689419 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12814f8-d51a-443d-af6b-d1193c1f400d None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:42.738441 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df5897-dd7b-4998-a026-cf9200dd7590 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:42.756093 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837c6a6-0a3a-46a4-a0d3-fb051cb069fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:42.757098 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837c6a6-0a3a-46a4-a0d3-fb051cb069fb None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:42.757585 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837c6a6-0a3a-46a4-a0d3-fb051cb069fb None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:42.758101 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837c6a6-0a3a-46a4-a0d3-fb051cb069fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:42.778370 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837c6a6-0a3a-46a4-a0d3-fb051cb069fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:42.784761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-9837c6a6-0a3a-46a4-a0d3-fb051cb069fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:12:42.784761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:42.784761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:42.784761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:42.784761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:42.784761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:42.784761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:42.784761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:42.784761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:42.784761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:42.784761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:42.784761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:42.784761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:42.784761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:42.784761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:42.784761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:42.785651 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:42.785651 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:42.785651 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:42.785651 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:42.785651 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:42.785651 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:42.785651 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:42.785651 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:42.785651 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:42.785651 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:42.785651 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:42.785651 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:42.785651 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:42.785651 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:42.785651 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:42.785651 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:42.786427 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:42.786427 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:42.786427 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:42.786427 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:42.786427 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:42.786427 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:42.786427 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:42.786427 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:42.786427 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:42.786427 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:42.786427 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:12:42.786427 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:42.791872 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 211/416] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:42.800022 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837c6a6-0a3a-46a4-a0d3-fb051cb069fb None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:42.810556 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec4847-2472-4327-89f3-a68f0ed4a955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:42.811554 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec4847-2472-4327-89f3-a68f0ed4a955 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:42.812096 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec4847-2472-4327-89f3-a68f0ed4a955 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:42.812572 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec4847-2472-4327-89f3-a68f0ed4a955 None admin] PATH_INFO: `/v3/projects/bcb322d69d74445d9641596caf1b6a8e` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:42.815403 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec4847-2472-4327-89f3-a68f0ed4a955 None admin] RBAC: Authorizing `identity:get_project(project_id=bcb322d69d74445d9641596caf1b6a8e)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:42.819314 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec4847-2472-4327-89f3-a68f0ed4a955 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:42.822672 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 206/417] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:42 2022] GET /identity/v3/projects/bcb322d69d74445d9641596caf1b6a8e => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:42.828625 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec4847-2472-4327-89f3-a68f0ed4a955 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:42.963893 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:42.974548 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837c6a6-0a3a-46a4-a0d3-fb051cb069fb None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:43.012898 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ddb08-46a3-4b39-8a58-68a002ec758d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:43.014182 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ddb08-46a3-4b39-8a58-68a002ec758d None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:43.014674 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ddb08-46a3-4b39-8a58-68a002ec758d None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:43.015217 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ddb08-46a3-4b39-8a58-68a002ec758d None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:43.016205 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ddb08-46a3-4b39-8a58-68a002ec758d None admin] RBAC: Adding query filter params (name=member) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:43.016847 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ddb08-46a3-4b39-8a58-68a002ec758d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:43.018434 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ddb08-46a3-4b39-8a58-68a002ec758d None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:43.028874 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 212/418] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 16:12:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:43.041600 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ddb08-46a3-4b39-8a58-68a002ec758d None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:43.054308 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec4847-2472-4327-89f3-a68f0ed4a955 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:43.055889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:43.091765 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9552d62-9824-46a8-b8d0-41909334804c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:43.092712 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9552d62-9824-46a8-b8d0-41909334804c None admin] REQUEST_METHOD: `PUT` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:43.093177 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9552d62-9824-46a8-b8d0-41909334804c None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:43.093595 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9552d62-9824-46a8-b8d0-41909334804c None admin] PATH_INFO: `/v3/projects/bcb322d69d74445d9641596caf1b6a8e/groups/579f054055c34719b3b5aafe234e1b1b/roles/cdb6d97b8d4a41e8aaec05181b77fada` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:43.096127 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9552d62-9824-46a8-b8d0-41909334804c None admin] RBAC: Authorizing `identity:create_grant(project_id=bcb322d69d74445d9641596caf1b6a8e, group_id=579f054055c34719b3b5aafe234e1b1b, role_id=cdb6d97b8d4a41e8aaec05181b77fada)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:43.097836 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9552d62-9824-46a8-b8d0-41909334804c None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:43.121178 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 207/419] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Jul 27 16:12:42 2022] PUT /identity/v3/projects/bcb322d69d74445d9641596caf1b6a8e/groups/579f054055c34719b3b5aafe234e1b1b/roles/cdb6d97b8d4a41e8aaec05181b77fada => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:12:43.209323 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ddb08-46a3-4b39-8a58-68a002ec758d None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:43.253742 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d673ea-f5cc-48d7-b376-b363e1fb9cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:43.254596 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d673ea-f5cc-48d7-b376-b363e1fb9cc5 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:43.255053 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d673ea-f5cc-48d7-b376-b363e1fb9cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:43.255489 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d673ea-f5cc-48d7-b376-b363e1fb9cc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:43.275433 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:43.342273 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46f328-8ab9-4700-a793-f77d9fdb2a0a None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:43.342605 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46f328-8ab9-4700-a793-f77d9fdb2a0a None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:43.342817 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46f328-8ab9-4700-a793-f77d9fdb2a0a None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:43.345518 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 208/420] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:12:43.349981 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c628386-f828-42ac-a226-61fa0d5d64fa None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:43.350272 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c628386-f828-42ac-a226-61fa0d5d64fa None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:43.350555 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c628386-f828-42ac-a226-61fa0d5d64fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:43.353831 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d673ea-f5cc-48d7-b376-b363e1fb9cc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:43.355543 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d673ea-f5cc-48d7-b376-b363e1fb9cc5 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:43.370628 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-5c628386-f828-42ac-a226-61fa0d5d64fa None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:43.371893 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-5c628386-f828-42ac-a226-61fa0d5d64fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:43.494808 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 209/421] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:12:43.519413 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 213/422] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:12:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 16:12:43.524322 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c628386-f828-42ac-a226-61fa0d5d64fa None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:43.527341 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d673ea-f5cc-48d7-b376-b363e1fb9cc5 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:43.578556 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:43.642976 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d673ea-f5cc-48d7-b376-b363e1fb9cc5 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:43.644485 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:43.656765 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c628386-f828-42ac-a226-61fa0d5d64fa None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:43.701300 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c293ab9-31ff-4faa-9d72-9e1789f12659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:43.702296 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c293ab9-31ff-4faa-9d72-9e1789f12659 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:43.702839 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c293ab9-31ff-4faa-9d72-9e1789f12659 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:43.703316 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c293ab9-31ff-4faa-9d72-9e1789f12659 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:43.704624 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce5e01-9c7f-44a0-a872-777b8153bc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:43.705284 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce5e01-9c7f-44a0-a872-777b8153bc0b None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:43.705573 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce5e01-9c7f-44a0-a872-777b8153bc0b None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:43.705855 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce5e01-9c7f-44a0-a872-777b8153bc0b None admin] PATH_INFO: `/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:43.712283 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce5e01-9c7f-44a0-a872-777b8153bc0b None admin] RBAC: Authorizing `identity:get_project(project_id=8ac4a2d636fc4ebdb5fd8e84d1834c46)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:43.713822 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce5e01-9c7f-44a0-a872-777b8153bc0b None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:43.715543 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 214/423] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:43 2022] GET /identity/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:43.716136 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c293ab9-31ff-4faa-9d72-9e1789f12659 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:43.721564 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce5e01-9c7f-44a0-a872-777b8153bc0b None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:43.722514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-7c293ab9-31ff-4faa-9d72-9e1789f12659 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:12:43.722514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:43.722514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:43.722514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:43.722514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:43.722514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:43.722514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:43.722514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:43.722514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:43.722514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:43.722514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:43.722514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:43.722514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:43.722514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:43.722514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:43.722514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:43.723431 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:43.723431 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:43.723431 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:43.723431 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:43.723431 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:43.723431 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:43.723431 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:43.723431 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:43.723431 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:43.723431 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:43.723431 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:43.723431 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:43.723431 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:43.723431 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:43.723431 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:43.723431 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:43.724239 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:43.724239 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:43.724239 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:43.724239 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:43.724239 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:43.724239 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:43.724239 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:43.724239 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:43.724239 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:43.724239 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:43.724239 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:12:43.724239 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:12:43.731437 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 210/424] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 16:12:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:43.732894 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c293ab9-31ff-4faa-9d72-9e1789f12659 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:43.824728 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce5e01-9c7f-44a0-a872-777b8153bc0b None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:43.840966 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c293ab9-31ff-4faa-9d72-9e1789f12659 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:43.845970 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:43.878569 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c797c-e875-4347-8dec-d4e915bfdb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:43.879199 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c797c-e875-4347-8dec-d4e915bfdb45 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:43.879522 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c797c-e875-4347-8dec-d4e915bfdb45 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:43.879808 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c797c-e875-4347-8dec-d4e915bfdb45 None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:43.880538 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c797c-e875-4347-8dec-d4e915bfdb45 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:43.880850 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c797c-e875-4347-8dec-d4e915bfdb45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:43.882223 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c797c-e875-4347-8dec-d4e915bfdb45 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:43.897324 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 211/425] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:12:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:43.898723 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c797c-e875-4347-8dec-d4e915bfdb45 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:43.917527 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:43.930797 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d75b3-8cce-4a5d-8eb9-011ffdfb779b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:43.932733 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d75b3-8cce-4a5d-8eb9-011ffdfb779b None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:43.933023 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d75b3-8cce-4a5d-8eb9-011ffdfb779b None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:43.933305 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d75b3-8cce-4a5d-8eb9-011ffdfb779b None admin] PATH_INFO: `/v3/groups/579f054055c34719b3b5aafe234e1b1b` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:43.935910 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d75b3-8cce-4a5d-8eb9-011ffdfb779b None admin] RBAC: Authorizing `identity:get_group(group_id=579f054055c34719b3b5aafe234e1b1b)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:43.939963 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d75b3-8cce-4a5d-8eb9-011ffdfb779b None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:43.944848 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 215/426] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 16:12:43 2022] GET /identity/v3/groups/579f054055c34719b3b5aafe234e1b1b => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:43.954705 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d75b3-8cce-4a5d-8eb9-011ffdfb779b None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:44.041014 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c797c-e875-4347-8dec-d4e915bfdb45 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:44.066004 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d75b3-8cce-4a5d-8eb9-011ffdfb779b None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:44.098953 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bada0f-a5c7-433f-875f-63fe636019e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:44.099986 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bada0f-a5c7-433f-875f-63fe636019e6 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:44.100533 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bada0f-a5c7-433f-875f-63fe636019e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:44.101011 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bada0f-a5c7-433f-875f-63fe636019e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:44.113841 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1224da0-65b3-4028-8063-6e67d1c8c6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:44.114842 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1224da0-65b3-4028-8063-6e67d1c8c6c2 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:44.115327 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1224da0-65b3-4028-8063-6e67d1c8c6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:44.115944 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1224da0-65b3-4028-8063-6e67d1c8c6c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:44.116824 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1224da0-65b3-4028-8063-6e67d1c8c6c2 None admin] RBAC: Adding query filter params (group.id=579f054055c34719b3b5aafe234e1b1b, role.id=5698bc4d332140e9af77ddcbb9915736, scope.project.id=8ac4a2d636fc4ebdb5fd8e84d1834c46) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:44.117207 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1224da0-65b3-4028-8063-6e67d1c8c6c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:44.118785 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1224da0-65b3-4028-8063-6e67d1c8c6c2 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:44.126368 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 216/427] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Jul 27 16:12:43 2022] GET /identity/v3/role_assignments?group.id=579f054055c34719b3b5aafe234e1b1b&scope.project.id=8ac4a2d636fc4ebdb5fd8e84d1834c46&role.id=5698bc4d332140e9af77ddcbb9915736 => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:44.189390 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bada0f-a5c7-433f-875f-63fe636019e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:44.191085 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bada0f-a5c7-433f-875f-63fe636019e6 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:44.212886 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:44.313800 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 212/428] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:12:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:12:44.319704 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1224da0-65b3-4028-8063-6e67d1c8c6c2 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:44.381018 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:44.444253 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1224da0-65b3-4028-8063-6e67d1c8c6c2 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:44.480805 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfa00f-bae6-4f55-8b49-e49a34aaf074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:44.481455 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfa00f-bae6-4f55-8b49-e49a34aaf074 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:44.481747 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfa00f-bae6-4f55-8b49-e49a34aaf074 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:44.482029 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfa00f-bae6-4f55-8b49-e49a34aaf074 None admin] PATH_INFO: `/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:44.483266 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bfa00f-bae6-4f55-8b49-e49a34aaf074 None admin] RBAC: Authorizing `identity:get_project(project_id=8ac4a2d636fc4ebdb5fd8e84d1834c46)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:44.485356 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bfa00f-bae6-4f55-8b49-e49a34aaf074 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:44.491482 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 217/429] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:44 2022] GET /identity/v3/projects/8ac4a2d636fc4ebdb5fd8e84d1834c46 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:44.493121 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bada0f-a5c7-433f-875f-63fe636019e6 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:44.603043 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bada0f-a5c7-433f-875f-63fe636019e6 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:44.620513 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:44.642340 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8453649-cf12-4759-8dc4-3766163379d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:44.642915 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8453649-cf12-4759-8dc4-3766163379d5 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:44.643201 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8453649-cf12-4759-8dc4-3766163379d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:44.643522 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8453649-cf12-4759-8dc4-3766163379d5 None admin] PATH_INFO: `/v3/groups/579f054055c34719b3b5aafe234e1b1b` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:44.644683 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8453649-cf12-4759-8dc4-3766163379d5 None admin] RBAC: Authorizing `identity:get_group(group_id=579f054055c34719b3b5aafe234e1b1b)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:44.646143 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8453649-cf12-4759-8dc4-3766163379d5 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:44.650172 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 213/430] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 16:12:44 2022] GET /identity/v3/groups/579f054055c34719b3b5aafe234e1b1b => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:44.654298 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfa00f-bae6-4f55-8b49-e49a34aaf074 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:44.768310 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfa00f-bae6-4f55-8b49-e49a34aaf074 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:44.777850 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:44.810819 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee770d-3ee2-4ef3-9a73-57c5f584cda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:44.811486 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee770d-3ee2-4ef3-9a73-57c5f584cda8 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:44.811806 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee770d-3ee2-4ef3-9a73-57c5f584cda8 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:44.812616 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee770d-3ee2-4ef3-9a73-57c5f584cda8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:44.813444 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee770d-3ee2-4ef3-9a73-57c5f584cda8 None admin] RBAC: Adding query filter params (group.id=579f054055c34719b3b5aafe234e1b1b, role.id=cdb6d97b8d4a41e8aaec05181b77fada, scope.project.id=8ac4a2d636fc4ebdb5fd8e84d1834c46) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:44.813761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee770d-3ee2-4ef3-9a73-57c5f584cda8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:44.817172 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee770d-3ee2-4ef3-9a73-57c5f584cda8 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:44.828527 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 218/431] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Jul 27 16:12:44 2022] GET /identity/v3/role_assignments?group.id=579f054055c34719b3b5aafe234e1b1b&scope.project.id=8ac4a2d636fc4ebdb5fd8e84d1834c46&role.id=cdb6d97b8d4a41e8aaec05181b77fada => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:44.881884 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30879fae-a1aa-401f-9a79-2d1edbeda4b9 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:44.882213 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30879fae-a1aa-401f-9a79-2d1edbeda4b9 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:44.882493 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30879fae-a1aa-401f-9a79-2d1edbeda4b9 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:44.884357 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 214/432] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:44.890823 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34aa33-6ff6-44f0-a6e5-a88677bd4046 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:44.891136 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34aa33-6ff6-44f0-a6e5-a88677bd4046 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:44.891403 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34aa33-6ff6-44f0-a6e5-a88677bd4046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:44.911605 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-3a34aa33-6ff6-44f0-a6e5-a88677bd4046 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:44.912775 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-3a34aa33-6ff6-44f0-a6e5-a88677bd4046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:44.991068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 219/433] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:45.015926 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30879fae-a1aa-401f-9a79-2d1edbeda4b9 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:45.127969 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30879fae-a1aa-401f-9a79-2d1edbeda4b9 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:45.177626 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2bd10-5fee-483e-b167-873e87c37bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:45.178268 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2bd10-5fee-483e-b167-873e87c37bc7 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:45.178498 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2bd10-5fee-483e-b167-873e87c37bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:45.178774 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2bd10-5fee-483e-b167-873e87c37bc7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:45.194687 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2bd10-5fee-483e-b167-873e87c37bc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:45.203771 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-cae2bd10-5fee-483e-b167-873e87c37bc7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:12:45.203771 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:45.203771 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:45.203771 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:45.203771 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:45.203771 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:45.203771 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:45.203771 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:45.203771 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:45.203771 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:45.203771 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:45.203771 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:45.203771 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:45.203771 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:45.203771 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:45.203771 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:45.204706 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:45.204706 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:45.204706 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:45.204706 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:45.204706 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:45.204706 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:45.204706 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:45.204706 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:45.204706 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:45.204706 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:45.204706 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:45.204706 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:45.204706 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:45.204706 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:45.204706 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:45.204706 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:45.205498 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:45.205498 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:45.205498 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:45.205498 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:45.205498 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:45.205498 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:45.205498 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:45.205498 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:45.205498 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:45.205498 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:45.205498 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:12:45.205498 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:12:45.205498 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 215/434] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 16:12:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:45.217356 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34aa33-6ff6-44f0-a6e5-a88677bd4046 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:45.378217 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34aa33-6ff6-44f0-a6e5-a88677bd4046 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:45.379962 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:45.417844 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897cb9d-b5b1-4120-99a4-3abafa3c0eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:45.418479 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897cb9d-b5b1-4120-99a4-3abafa3c0eb4 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:45.418765 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897cb9d-b5b1-4120-99a4-3abafa3c0eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:45.419046 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897cb9d-b5b1-4120-99a4-3abafa3c0eb4 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:45.419805 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8897cb9d-b5b1-4120-99a4-3abafa3c0eb4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:45.420116 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8897cb9d-b5b1-4120-99a4-3abafa3c0eb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:45.422147 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8897cb9d-b5b1-4120-99a4-3abafa3c0eb4 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:45.435912 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 220/435] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:45.441445 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2bd10-5fee-483e-b167-873e87c37bc7 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:45.466750 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e86d2-ac73-4a71-a5ec-cd40d2013603 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:45.467580 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e86d2-ac73-4a71-a5ec-cd40d2013603 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:45.468277 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e86d2-ac73-4a71-a5ec-cd40d2013603 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:45.470336 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 221/436] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:12:45.477471 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c14af8-5794-4d99-8f95-49f91a4b4481 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:45.478996 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c14af8-5794-4d99-8f95-49f91a4b4481 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:45.479664 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c14af8-5794-4d99-8f95-49f91a4b4481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:45.516208 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-f5c14af8-5794-4d99-8f95-49f91a4b4481 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:45.517667 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-f5c14af8-5794-4d99-8f95-49f91a4b4481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:45.536923 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:45.636891 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2bd10-5fee-483e-b167-873e87c37bc7 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:45.638288 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 222/437] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:12:45.662257 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c14af8-5794-4d99-8f95-49f91a4b4481 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:45.678720 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc95575-bc17-41c0-a79a-1afa5a61452f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:45.679192 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc95575-bc17-41c0-a79a-1afa5a61452f None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:45.683293 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc95575-bc17-41c0-a79a-1afa5a61452f None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:45.683293 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc95575-bc17-41c0-a79a-1afa5a61452f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:45.757904 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc95575-bc17-41c0-a79a-1afa5a61452f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:45.759275 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc95575-bc17-41c0-a79a-1afa5a61452f None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:45.770395 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:45.778399 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c14af8-5794-4d99-8f95-49f91a4b4481 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:45.804352 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:45.818929 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0773d-8131-475c-b96e-b116af6fddcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:45.819611 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0773d-8131-475c-b96e-b116af6fddcf None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:45.819896 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0773d-8131-475c-b96e-b116af6fddcf None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:45.820175 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0773d-8131-475c-b96e-b116af6fddcf None admin] PATH_INFO: `/v3/roles/member` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:45.831675 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0773d-8131-475c-b96e-b116af6fddcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:45.836801 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-36a0773d-8131-475c-b96e-b116af6fddcf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:12:45.836801 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:45.836801 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:45.836801 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:45.836801 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:45.836801 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:45.836801 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:45.836801 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:45.836801 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:45.836801 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:45.836801 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:45.836801 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:45.836801 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:45.836801 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:45.836801 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:45.836801 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:45.837689 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:45.837689 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:45.837689 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:45.837689 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:45.837689 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:45.837689 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:45.837689 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:45.837689 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:45.837689 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:45.837689 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:45.837689 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:45.837689 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:45.837689 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:45.837689 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:45.837689 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:45.837689 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:45.838477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:45.838477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:45.838477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:45.838477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:45.838477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:45.838477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:45.838477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:45.838477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:45.838477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:45.838477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:45.838477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:12:45.838477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:45.838477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 223/438] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:12:45.843682 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0773d-8131-475c-b96e-b116af6fddcf None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:45.872961 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 216/439] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:12:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:12:45.874092 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc95575-bc17-41c0-a79a-1afa5a61452f None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:45.957103 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0773d-8131-475c-b96e-b116af6fddcf None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:45.989696 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc95575-bc17-41c0-a79a-1afa5a61452f None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:45.993373 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20f40c-7d5c-45ad-b76c-000f83fb6bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:45.993725 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20f40c-7d5c-45ad-b76c-000f83fb6bed None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:45.994013 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20f40c-7d5c-45ad-b76c-000f83fb6bed None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:45.994302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20f40c-7d5c-45ad-b76c-000f83fb6bed None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:45.995029 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20f40c-7d5c-45ad-b76c-000f83fb6bed None admin] RBAC: Adding query filter params (name=member) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:45.995343 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20f40c-7d5c-45ad-b76c-000f83fb6bed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:45.996778 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20f40c-7d5c-45ad-b76c-000f83fb6bed None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:46.006046 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 224/440] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 16:12:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:46.011606 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20f40c-7d5c-45ad-b76c-000f83fb6bed None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:46.027293 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c8e5f-6beb-4cec-abec-61820d68f812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:46.027967 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c8e5f-6beb-4cec-abec-61820d68f812 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:46.028248 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c8e5f-6beb-4cec-abec-61820d68f812 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:46.028648 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c8e5f-6beb-4cec-abec-61820d68f812 None admin] PATH_INFO: `/v3/projects/4e89005d4d794906addd0b11c7e81008` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:46.029795 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c8e5f-6beb-4cec-abec-61820d68f812 None admin] RBAC: Authorizing `identity:get_project(project_id=4e89005d4d794906addd0b11c7e81008)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:46.030216 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:46.032495 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c8e5f-6beb-4cec-abec-61820d68f812 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:46.034323 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 217/441] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:45 2022] GET /identity/v3/projects/4e89005d4d794906addd0b11c7e81008 => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:46.039772 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c8e5f-6beb-4cec-abec-61820d68f812 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:46.052428 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:46.113866 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20f40c-7d5c-45ad-b76c-000f83fb6bed None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:46.139094 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c8e5f-6beb-4cec-abec-61820d68f812 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:46.147481 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4192a7-4c46-421b-8a2f-0840e169b39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:46.148104 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4192a7-4c46-421b-8a2f-0840e169b39c None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:46.148378 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4192a7-4c46-421b-8a2f-0840e169b39c None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:46.148649 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4192a7-4c46-421b-8a2f-0840e169b39c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:46.174164 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6d5d1-36fc-4c25-b140-d1f4f0dddd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:46.174809 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6d5d1-36fc-4c25-b140-d1f4f0dddd6b None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:46.175093 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6d5d1-36fc-4c25-b140-d1f4f0dddd6b None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:46.175392 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6d5d1-36fc-4c25-b140-d1f4f0dddd6b None admin] PATH_INFO: `/v3/groups/b411415c3de74a698dcc4406cfd0e5c1` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:46.176560 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6d5d1-36fc-4c25-b140-d1f4f0dddd6b None admin] RBAC: Authorizing `identity:get_group(group_id=b411415c3de74a698dcc4406cfd0e5c1)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:46.178010 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6d5d1-36fc-4c25-b140-d1f4f0dddd6b None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:46.179724 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 218/442] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 16:12:46 2022] GET /identity/v3/groups/b411415c3de74a698dcc4406cfd0e5c1 => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:46.180855 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ec43d-8a39-480a-b0c4-5c7c3a356513 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:46.181139 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ec43d-8a39-480a-b0c4-5c7c3a356513 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:46.181415 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ec43d-8a39-480a-b0c4-5c7c3a356513 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:46.182780 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 219/443] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:46.187976 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ec43d-8a39-480a-b0c4-5c7c3a356513 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:46.218403 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4192a7-4c46-421b-8a2f-0840e169b39c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:46.219904 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4192a7-4c46-421b-8a2f-0840e169b39c None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:46.237221 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:46.265510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:46.288616 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ec43d-8a39-480a-b0c4-5c7c3a356513 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:46.320955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 225/444] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:12:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 16:12:46.322209 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ad006-ead0-4fda-9783-e49ecf8e7e4e None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:46.322508 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ad006-ead0-4fda-9783-e49ecf8e7e4e None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:46.322791 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ad006-ead0-4fda-9783-e49ecf8e7e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:46.327852 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269cee2-0eb4-4019-b70a-ed0cf6e94e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:46.328471 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269cee2-0eb4-4019-b70a-ed0cf6e94e47 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:46.328881 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269cee2-0eb4-4019-b70a-ed0cf6e94e47 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:46.329050 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269cee2-0eb4-4019-b70a-ed0cf6e94e47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:46.329841 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269cee2-0eb4-4019-b70a-ed0cf6e94e47 None admin] RBAC: Adding query filter params (group.id=b411415c3de74a698dcc4406cfd0e5c1, role.id=76e01abae9964dd5b28fc8895f739ee4, scope.project.id=4e89005d4d794906addd0b11c7e81008) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:46.330155 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269cee2-0eb4-4019-b70a-ed0cf6e94e47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:46.331597 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269cee2-0eb4-4019-b70a-ed0cf6e94e47 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:46.337876 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 220/445] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Jul 27 16:12:46 2022] GET /identity/v3/role_assignments?group.id=b411415c3de74a698dcc4406cfd0e5c1&scope.project.id=4e89005d4d794906addd0b11c7e81008&role.id=76e01abae9964dd5b28fc8895f739ee4 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:46.338659 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269cee2-0eb4-4019-b70a-ed0cf6e94e47 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:46.340676 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-911ad006-ead0-4fda-9783-e49ecf8e7e4e None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:46.341869 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-911ad006-ead0-4fda-9783-e49ecf8e7e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:46.428423 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 226/446] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:46.453689 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ad006-ead0-4fda-9783-e49ecf8e7e4e None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:46.459564 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269cee2-0eb4-4019-b70a-ed0cf6e94e47 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:46.502131 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1970f-dc25-4152-ab87-5c03b62e236a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:46.502805 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1970f-dc25-4152-ab87-5c03b62e236a None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:46.503088 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1970f-dc25-4152-ab87-5c03b62e236a None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:46.503366 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1970f-dc25-4152-ab87-5c03b62e236a None admin] PATH_INFO: `/v3/projects/bcb322d69d74445d9641596caf1b6a8e` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:46.504667 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f1970f-dc25-4152-ab87-5c03b62e236a None admin] RBAC: Authorizing `identity:get_project(project_id=bcb322d69d74445d9641596caf1b6a8e)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:46.506175 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f1970f-dc25-4152-ab87-5c03b62e236a None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:46.507906 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 221/447] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:46 2022] GET /identity/v3/projects/bcb322d69d74445d9641596caf1b6a8e => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:46.513442 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1970f-dc25-4152-ab87-5c03b62e236a None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:46.516327 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:46.528304 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:46.594924 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ad006-ead0-4fda-9783-e49ecf8e7e4e None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:46.628238 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1970f-dc25-4152-ab87-5c03b62e236a None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:46.630846 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf264b0-1507-4397-b8b2-511bf28a348c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:46.631525 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf264b0-1507-4397-b8b2-511bf28a348c None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:46.631812 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf264b0-1507-4397-b8b2-511bf28a348c None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:46.632091 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf264b0-1507-4397-b8b2-511bf28a348c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:46.643032 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf264b0-1507-4397-b8b2-511bf28a348c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:46.648108 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-4cf264b0-1507-4397-b8b2-511bf28a348c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:12:46.648108 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:46.648108 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:46.648108 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:46.648108 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:46.648108 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:46.648108 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:46.648108 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:46.648108 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:46.648108 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:46.648108 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:46.648108 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:46.648108 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:46.648108 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:46.648108 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:46.648108 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:46.648985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:46.648985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:46.648985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:46.648985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:46.648985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:46.648985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:46.648985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:46.648985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:46.648985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:46.648985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:46.648985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:46.648985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:46.648985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:46.648985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:46.648985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:46.648985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:46.649796 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:46.649796 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:46.649796 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:46.649796 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:46.649796 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:46.649796 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:46.649796 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:46.649796 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:46.649796 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:46.649796 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:46.649796 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:12:46.649796 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:46.649796 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 227/448] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 16:12:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:12:46.655072 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf264b0-1507-4397-b8b2-511bf28a348c None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:46.669804 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc6ebf-c013-463c-9787-df457f06e2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:46.670467 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc6ebf-c013-463c-9787-df457f06e2ad None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:46.670755 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc6ebf-c013-463c-9787-df457f06e2ad None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:46.673515 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc6ebf-c013-463c-9787-df457f06e2ad None admin] PATH_INFO: `/v3/groups/579f054055c34719b3b5aafe234e1b1b` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:46.673515 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc6ebf-c013-463c-9787-df457f06e2ad None admin] RBAC: Authorizing `identity:get_group(group_id=579f054055c34719b3b5aafe234e1b1b)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:46.673973 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc6ebf-c013-463c-9787-df457f06e2ad None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:46.680467 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 222/449] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 16:12:46 2022] GET /identity/v3/groups/579f054055c34719b3b5aafe234e1b1b => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:46.681490 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc6ebf-c013-463c-9787-df457f06e2ad None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:46.757122 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf264b0-1507-4397-b8b2-511bf28a348c None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:46.759160 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:46.764914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:46.782440 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc6ebf-c013-463c-9787-df457f06e2ad None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:46.792324 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d2cbc9-6f04-4493-bc89-21a5c963fd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:46.792944 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2cbc9-6f04-4493-bc89-21a5c963fd3d None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:46.793230 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2cbc9-6f04-4493-bc89-21a5c963fd3d None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:46.793515 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2cbc9-6f04-4493-bc89-21a5c963fd3d None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:46.794233 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d2cbc9-6f04-4493-bc89-21a5c963fd3d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:46.794544 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d2cbc9-6f04-4493-bc89-21a5c963fd3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:46.795973 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d2cbc9-6f04-4493-bc89-21a5c963fd3d None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:46.803890 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 228/450] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:12:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:46.809456 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d2cbc9-6f04-4493-bc89-21a5c963fd3d None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:46.819095 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173a75a-2197-4d18-9740-a7fc26d0fa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:46.819762 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173a75a-2197-4d18-9740-a7fc26d0fa5d None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:46.820051 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173a75a-2197-4d18-9740-a7fc26d0fa5d None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:46.820330 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173a75a-2197-4d18-9740-a7fc26d0fa5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:46.821121 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173a75a-2197-4d18-9740-a7fc26d0fa5d None admin] RBAC: Adding query filter params (group.id=579f054055c34719b3b5aafe234e1b1b, role.id=5698bc4d332140e9af77ddcbb9915736, scope.project.id=bcb322d69d74445d9641596caf1b6a8e) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:46.821436 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173a75a-2197-4d18-9740-a7fc26d0fa5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:46.822871 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173a75a-2197-4d18-9740-a7fc26d0fa5d None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:46.829261 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 223/451] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Jul 27 16:12:46 2022] GET /identity/v3/role_assignments?group.id=579f054055c34719b3b5aafe234e1b1b&scope.project.id=bcb322d69d74445d9641596caf1b6a8e&role.id=5698bc4d332140e9af77ddcbb9915736 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:46.931179 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d2cbc9-6f04-4493-bc89-21a5c963fd3d None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:46.974151 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151354e-7c72-43b2-a153-b5e946eb1e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:46.974795 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151354e-7c72-43b2-a153-b5e946eb1e0e None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:46.975082 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151354e-7c72-43b2-a153-b5e946eb1e0e None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:46.975362 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151354e-7c72-43b2-a153-b5e946eb1e0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:47.012491 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:47.047709 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151354e-7c72-43b2-a153-b5e946eb1e0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:47.049178 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151354e-7c72-43b2-a153-b5e946eb1e0e None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:47.153164 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 229/452] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:12:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 16:12:47.159672 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173a75a-2197-4d18-9740-a7fc26d0fa5d None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:47.272651 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173a75a-2197-4d18-9740-a7fc26d0fa5d None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:47.307456 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87263274-5217-45e2-8214-bbb9f32c8ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:47.308065 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87263274-5217-45e2-8214-bbb9f32c8ddf None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:47.308354 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87263274-5217-45e2-8214-bbb9f32c8ddf None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:47.308634 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87263274-5217-45e2-8214-bbb9f32c8ddf None admin] PATH_INFO: `/v3/projects/bcb322d69d74445d9641596caf1b6a8e` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:47.309806 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87263274-5217-45e2-8214-bbb9f32c8ddf None admin] RBAC: Authorizing `identity:get_project(project_id=bcb322d69d74445d9641596caf1b6a8e)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:47.311275 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87263274-5217-45e2-8214-bbb9f32c8ddf None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:47.313009 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 224/453] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 16:12:47 2022] GET /identity/v3/projects/bcb322d69d74445d9641596caf1b6a8e => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:47.318564 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151354e-7c72-43b2-a153-b5e946eb1e0e None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:47.383620 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:47.416148 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151354e-7c72-43b2-a153-b5e946eb1e0e None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:47.449250 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ee645-904b-4f72-89bc-9dfe256c2fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:47.449865 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ee645-904b-4f72-89bc-9dfe256c2fde None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:47.450148 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ee645-904b-4f72-89bc-9dfe256c2fde None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:47.450426 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ee645-904b-4f72-89bc-9dfe256c2fde None admin] PATH_INFO: `/v3/groups/579f054055c34719b3b5aafe234e1b1b` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:47.451771 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ee645-904b-4f72-89bc-9dfe256c2fde None admin] RBAC: Authorizing `identity:get_group(group_id=579f054055c34719b3b5aafe234e1b1b)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:47.453238 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ee645-904b-4f72-89bc-9dfe256c2fde None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:47.454839 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 230/454] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 16:12:47 2022] GET /identity/v3/groups/579f054055c34719b3b5aafe234e1b1b => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:47.460745 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87263274-5217-45e2-8214-bbb9f32c8ddf None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:47.473755 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:47.565792 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87263274-5217-45e2-8214-bbb9f32c8ddf None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:47.598806 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19375891-45f0-4025-adb7-59e43b9a262e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:47.599448 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19375891-45f0-4025-adb7-59e43b9a262e None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:47.599738 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19375891-45f0-4025-adb7-59e43b9a262e None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:47.600015 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19375891-45f0-4025-adb7-59e43b9a262e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:47.600793 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19375891-45f0-4025-adb7-59e43b9a262e None admin] RBAC: Adding query filter params (group.id=579f054055c34719b3b5aafe234e1b1b, role.id=cdb6d97b8d4a41e8aaec05181b77fada, scope.project.id=bcb322d69d74445d9641596caf1b6a8e) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:47.601132 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19375891-45f0-4025-adb7-59e43b9a262e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:47.602563 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19375891-45f0-4025-adb7-59e43b9a262e None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:47.608239 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 225/455] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Jul 27 16:12:47 2022] GET /identity/v3/role_assignments?group.id=579f054055c34719b3b5aafe234e1b1b&scope.project.id=bcb322d69d74445d9641596caf1b6a8e&role.id=cdb6d97b8d4a41e8aaec05181b77fada => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:50.242107 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe1c32-edf5-4a5e-a45c-fb508caa0e5b None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:50.242636 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe1c32-edf5-4a5e-a45c-fb508caa0e5b None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:50.242709 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe1c32-edf5-4a5e-a45c-fb508caa0e5b None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:50.244405 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 231/456] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:50.250963 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601841be-0932-4af8-93d6-50fd23fa034b None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:50.251981 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601841be-0932-4af8-93d6-50fd23fa034b None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:50.252473 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601841be-0932-4af8-93d6-50fd23fa034b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:50.272644 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-601841be-0932-4af8-93d6-50fd23fa034b None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:50.274223 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-601841be-0932-4af8-93d6-50fd23fa034b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:50.348435 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 226/457] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:50.373528 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe1c32-edf5-4a5e-a45c-fb508caa0e5b None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:50.406615 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea67b9-f5ce-4105-b8b7-2fdaf11606ef None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:50.406810 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea67b9-f5ce-4105-b8b7-2fdaf11606ef None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:50.407020 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea67b9-f5ce-4105-b8b7-2fdaf11606ef None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:50.409034 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 227/458] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:12:50.415078 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56968029-c1e6-486d-aacb-c973d4de4fcc None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:50.415404 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56968029-c1e6-486d-aacb-c973d4de4fcc None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:50.415664 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56968029-c1e6-486d-aacb-c973d4de4fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:50.425809 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:50.442826 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-56968029-c1e6-486d-aacb-c973d4de4fcc None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:50.444455 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-56968029-c1e6-486d-aacb-c973d4de4fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:50.500546 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe1c32-edf5-4a5e-a45c-fb508caa0e5b None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:50.534934 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 228/459] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:50.547980 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93a811-5c43-40f6-8f64-340ebe70f501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:50.548693 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93a811-5c43-40f6-8f64-340ebe70f501 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:50.548991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93a811-5c43-40f6-8f64-340ebe70f501 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:50.549267 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93a811-5c43-40f6-8f64-340ebe70f501 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:50.550739 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9600c-2faf-4e06-9491-ae0b060bd5e9 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:50.551323 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9600c-2faf-4e06-9491-ae0b060bd5e9 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:50.551777 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9600c-2faf-4e06-9491-ae0b060bd5e9 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:50.553478 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 229/460] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:50.559695 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:50.560851 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9626c-5198-4f97-9535-04613fc71cd6 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:50.560993 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec93a811-5c43-40f6-8f64-340ebe70f501 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:50.561082 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9626c-5198-4f97-9535-04613fc71cd6 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:50.561154 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9626c-5198-4f97-9535-04613fc71cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:50.562559 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec93a811-5c43-40f6-8f64-340ebe70f501 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:50.579603 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-ec93a811-5c43-40f6-8f64-340ebe70f501 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:12:50.579603 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:50.579603 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:50.579603 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:50.579603 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:50.579603 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:50.579603 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:50.579603 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:50.579603 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:50.579603 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:50.579603 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:50.579603 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:50.579603 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:12:50.579603 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:12:50.579603 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:12:50.580547 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:12:50.580547 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:50.580547 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:50.580547 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:50.580547 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:50.580547 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:50.580547 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:50.580547 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:50.580547 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:50.580547 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:50.580547 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:50.580547 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:50.580547 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:50.580547 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:50.580547 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:50.580547 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:50.580547 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:50.581391 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:12:50.581391 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:12:50.581391 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:12:50.581391 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:50.581391 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 232/461] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:12:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:50.582117 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93a811-5c43-40f6-8f64-340ebe70f501 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:50.588236 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-36b9626c-5198-4f97-9535-04613fc71cd6 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:50.588236 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-36b9626c-5198-4f97-9535-04613fc71cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:50.663674 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 230/462] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:50.663674 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9626c-5198-4f97-9535-04613fc71cd6 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:50.701590 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93a811-5c43-40f6-8f64-340ebe70f501 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:50.730650 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:50.744421 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb36ef-a8c2-49de-a2ab-e78f3bbd9d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:50.745069 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb36ef-a8c2-49de-a2ab-e78f3bbd9d43 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:50.745352 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb36ef-a8c2-49de-a2ab-e78f3bbd9d43 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:50.745628 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb36ef-a8c2-49de-a2ab-e78f3bbd9d43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:50.757725 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb36ef-a8c2-49de-a2ab-e78f3bbd9d43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:50.759287 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb36ef-a8c2-49de-a2ab-e78f3bbd9d43 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:50.774095 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-7dfb36ef-a8c2-49de-a2ab-e78f3bbd9d43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:12:50.774095 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:50.774095 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:50.774095 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:50.774095 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:50.774095 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:50.774095 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:50.774095 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:50.774095 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:50.774095 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:50.774095 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:50.774095 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:50.774095 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:12:50.774095 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:12:50.774095 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:12:50.774978 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:12:50.774978 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:50.774978 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:50.774978 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:50.774978 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:50.774978 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:50.774978 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:50.774978 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:50.774978 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:50.774978 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:50.774978 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:50.774978 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:50.774978 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:50.774978 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:50.774978 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:50.774978 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:50.774978 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:50.780902 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:12:50.780902 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:12:50.780902 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:12:50.780902 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:50.781123 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9626c-5198-4f97-9535-04613fc71cd6 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:50.781196 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 233/463] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:12:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:50.781196 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb36ef-a8c2-49de-a2ab-e78f3bbd9d43 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:50.820261 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21698a6-a82c-4810-940c-a96434ec4eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:50.821052 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21698a6-a82c-4810-940c-a96434ec4eec None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:50.821228 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:50.821431 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21698a6-a82c-4810-940c-a96434ec4eec None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:50.821783 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21698a6-a82c-4810-940c-a96434ec4eec None admin] PATH_INFO: `/v3/domains` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:50.822583 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21698a6-a82c-4810-940c-a96434ec4eec None admin] RBAC: Adding query filter params (name=Default) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:50.822968 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21698a6-a82c-4810-940c-a96434ec4eec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:50.824444 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21698a6-a82c-4810-940c-a96434ec4eec None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:50.836372 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 231/464] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:50.836372 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21698a6-a82c-4810-940c-a96434ec4eec None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:50.888856 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb36ef-a8c2-49de-a2ab-e78f3bbd9d43 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:50.923025 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c77e11-e204-46a2-b439-94511c9e1584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:50.923705 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c77e11-e204-46a2-b439-94511c9e1584 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:50.924083 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c77e11-e204-46a2-b439-94511c9e1584 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:50.924272 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c77e11-e204-46a2-b439-94511c9e1584 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:50.935153 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c77e11-e204-46a2-b439-94511c9e1584 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:50.936658 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c77e11-e204-46a2-b439-94511c9e1584 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:50.942812 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21698a6-a82c-4810-940c-a96434ec4eec None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:50.952101 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-b3c77e11-e204-46a2-b439-94511c9e1584 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:12:50.952101 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:50.952101 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:50.952101 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:50.952101 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:50.952101 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:50.952101 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:50.952101 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:50.952101 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:50.952101 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:50.952101 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:50.952101 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:50.952101 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:12:50.952101 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:12:50.952101 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:12:50.953045 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:12:50.953045 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:50.953045 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:50.953045 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:50.953045 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:50.953045 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:50.953045 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:50.953045 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:50.953045 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:50.953045 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:50.953045 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:50.953045 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:50.953045 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:50.953045 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:50.953045 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:50.953045 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:50.953045 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:50.953896 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:12:50.953896 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:12:50.953896 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:12:50.953896 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:50.953896 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 234/465] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:12:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:50.954155 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c77e11-e204-46a2-b439-94511c9e1584 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:50.969146 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:50.980218 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb3481d-7e2b-410d-ab56-addaba3140dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:50.980837 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3481d-7e2b-410d-ab56-addaba3140dd None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:50.981121 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3481d-7e2b-410d-ab56-addaba3140dd None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:50.981397 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3481d-7e2b-410d-ab56-addaba3140dd None admin] PATH_INFO: `/v3/domains` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:50.982080 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb3481d-7e2b-410d-ab56-addaba3140dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:50.982389 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb3481d-7e2b-410d-ab56-addaba3140dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:50.984318 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb3481d-7e2b-410d-ab56-addaba3140dd None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:50.995939 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 232/466] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:50.997461 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21c7ed-b559-4af2-b782-7e46282f5ed7 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:50.997753 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21c7ed-b559-4af2-b782-7e46282f5ed7 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:50.998112 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21c7ed-b559-4af2-b782-7e46282f5ed7 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:50.999249 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 233/467] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:51.000525 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21c7ed-b559-4af2-b782-7e46282f5ed7 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:51.052591 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:51.062671 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c77e11-e204-46a2-b439-94511c9e1584 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:51.096027 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68baf2-138c-4ccf-b5e9-81a64b92a8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:51.096644 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68baf2-138c-4ccf-b5e9-81a64b92a8ce None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:51.096927 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68baf2-138c-4ccf-b5e9-81a64b92a8ce None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:51.097204 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68baf2-138c-4ccf-b5e9-81a64b92a8ce None admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:51.097880 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68baf2-138c-4ccf-b5e9-81a64b92a8ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:51.099323 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68baf2-138c-4ccf-b5e9-81a64b92a8ce None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:51.101856 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21c7ed-b559-4af2-b782-7e46282f5ed7 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:51.119991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 235/468] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 16:12:50 2022] POST /identity/v3/users => generated 246 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:12:51.120892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68baf2-138c-4ccf-b5e9-81a64b92a8ce None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:51.138842 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4da141-9c98-445e-8136-9d1fff46e590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:51.139522 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4da141-9c98-445e-8136-9d1fff46e590 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:51.139811 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4da141-9c98-445e-8136-9d1fff46e590 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:51.140652 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4da141-9c98-445e-8136-9d1fff46e590 None admin] PATH_INFO: `/v3/domains` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:51.141363 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4da141-9c98-445e-8136-9d1fff46e590 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:51.141722 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4da141-9c98-445e-8136-9d1fff46e590 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:51.143162 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4da141-9c98-445e-8136-9d1fff46e590 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:51.162406 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 234/469] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:51.162406 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e907fd-ee68-4a04-8bb0-e21be0204e84 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:51.162406 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e907fd-ee68-4a04-8bb0-e21be0204e84 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:51.162406 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e907fd-ee68-4a04-8bb0-e21be0204e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:51.181495 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-83e907fd-ee68-4a04-8bb0-e21be0204e84 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:51.182742 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-83e907fd-ee68-4a04-8bb0-e21be0204e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:51.231856 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:51.251578 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68baf2-138c-4ccf-b5e9-81a64b92a8ce None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:51.264281 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 235/470] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:51.266568 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e907fd-ee68-4a04-8bb0-e21be0204e84 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:51.304633 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27714873-907a-4e41-8723-fc0925bc517b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:51.305347 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27714873-907a-4e41-8723-fc0925bc517b None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:51.305684 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27714873-907a-4e41-8723-fc0925bc517b None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:51.306107 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27714873-907a-4e41-8723-fc0925bc517b None admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:51.307038 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27714873-907a-4e41-8723-fc0925bc517b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:51.308608 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27714873-907a-4e41-8723-fc0925bc517b None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:51.333368 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 236/471] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 16:12:51 2022] POST /identity/v3/users => generated 248 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:12:51.335026 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27714873-907a-4e41-8723-fc0925bc517b None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:51.340217 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:51.397575 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e907fd-ee68-4a04-8bb0-e21be0204e84 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:51.440634 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1dff2-8d32-4c1b-b72b-45fabb16b60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:51.441408 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1dff2-8d32-4c1b-b72b-45fabb16b60e None admin] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:51.441990 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1dff2-8d32-4c1b-b72b-45fabb16b60e None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:51.442268 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1dff2-8d32-4c1b-b72b-45fabb16b60e None admin] PATH_INFO: `/v3/users` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:51.443087 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1dff2-8d32-4c1b-b72b-45fabb16b60e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:51.444610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1dff2-8d32-4c1b-b72b-45fabb16b60e None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:51.473233 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27714873-907a-4e41-8723-fc0925bc517b None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:51.477153 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 236/472] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 16:12:51 2022] POST /identity/v3/users => generated 248 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:12:51.522561 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75112760-5a3e-436e-a5b8-2d2d138c550e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:51.523232 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75112760-5a3e-436e-a5b8-2d2d138c550e None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:51.523571 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75112760-5a3e-436e-a5b8-2d2d138c550e None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:51.523906 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75112760-5a3e-436e-a5b8-2d2d138c550e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:51.536747 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75112760-5a3e-436e-a5b8-2d2d138c550e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:51.538349 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75112760-5a3e-436e-a5b8-2d2d138c550e None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:51.556525 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-75112760-5a3e-436e-a5b8-2d2d138c550e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:12:51.556525 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:51.556525 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:51.556525 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:51.556525 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:51.556525 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:51.556525 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:51.556525 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:51.556525 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:51.556525 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:51.556525 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:51.556525 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:51.556525 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:12:51.556525 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:12:51.556525 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:12:51.557390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:12:51.557390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:51.557390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:51.557390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:51.557390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:51.557390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:51.557390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:51.557390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:51.557390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:51.557390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:51.557390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:51.557390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:51.557390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:51.557390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:51.557390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:51.557390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:51.557390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:51.558237 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:12:51.558237 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:12:51.558237 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:12:51.558237 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:51.558237 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 237/473] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:12:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:51.566223 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1dff2-8d32-4c1b-b72b-45fabb16b60e None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:51.607543 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:51.698882 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1dff2-8d32-4c1b-b72b-45fabb16b60e None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:51.738165 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ba78e-1646-46ba-9ab9-512af5f0efd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:51.738798 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ba78e-1646-46ba-9ab9-512af5f0efd6 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:51.739086 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ba78e-1646-46ba-9ab9-512af5f0efd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:51.739366 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ba78e-1646-46ba-9ab9-512af5f0efd6 None admin] PATH_INFO: `/v3/domains` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:51.740120 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ba78e-1646-46ba-9ab9-512af5f0efd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:51.740428 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ba78e-1646-46ba-9ab9-512af5f0efd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:51.741808 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ba78e-1646-46ba-9ab9-512af5f0efd6 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:51.756195 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 237/474] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:51.761730 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75112760-5a3e-436e-a5b8-2d2d138c550e None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:51.824872 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:51.875933 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75112760-5a3e-436e-a5b8-2d2d138c550e None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:51.911594 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc939f-a3a2-425b-940e-7bbc278e5fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:51.912570 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc939f-a3a2-425b-940e-7bbc278e5fb4 None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:51.913032 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc939f-a3a2-425b-940e-7bbc278e5fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:51.913732 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc939f-a3a2-425b-940e-7bbc278e5fb4 None admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:51.914620 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc939f-a3a2-425b-940e-7bbc278e5fb4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:51.916301 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc939f-a3a2-425b-940e-7bbc278e5fb4 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:51.942118 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 238/475] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 16:12:51 2022] POST /identity/v3/users => generated 249 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:12:53.600692 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205084a-acfc-4d0f-93d3-c004ba8fcb81 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:53.601209 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205084a-acfc-4d0f-93d3-c004ba8fcb81 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:53.601486 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205084a-acfc-4d0f-93d3-c004ba8fcb81 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:53.603023 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 238/476] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:53.611415 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d175a8-753b-4b89-a492-a2f2abedf170 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:53.611415 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d175a8-753b-4b89-a492-a2f2abedf170 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:53.611415 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d175a8-753b-4b89-a492-a2f2abedf170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:53.630405 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-e9d175a8-753b-4b89-a492-a2f2abedf170 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:53.632066 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-e9d175a8-753b-4b89-a492-a2f2abedf170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:53.711457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 239/477] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:53.736284 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205084a-acfc-4d0f-93d3-c004ba8fcb81 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:53.798413 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312047a-bc41-4c8f-93c1-486d10445f14 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:53.798772 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312047a-bc41-4c8f-93c1-486d10445f14 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:53.798967 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312047a-bc41-4c8f-93c1-486d10445f14 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:53.800748 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 240/478] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:53.806576 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276d88b-4fc7-4dd0-a877-6698b1e325c5 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:53.806864 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276d88b-4fc7-4dd0-a877-6698b1e325c5 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:53.807152 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276d88b-4fc7-4dd0-a877-6698b1e325c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:53.827504 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-6276d88b-4fc7-4dd0-a877-6698b1e325c5 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:53.829221 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-6276d88b-4fc7-4dd0-a877-6698b1e325c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:53.845708 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:53.858571 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205084a-acfc-4d0f-93d3-c004ba8fcb81 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:53.867949 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:53.906700 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb381984-a135-44ae-bc03-67459ba5d615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:53.907748 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb381984-a135-44ae-bc03-67459ba5d615 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:53.908241 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb381984-a135-44ae-bc03-67459ba5d615 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:53.908708 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb381984-a135-44ae-bc03-67459ba5d615 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:53.911510 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 241/479] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:12:53.921263 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb381984-a135-44ae-bc03-67459ba5d615 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:53.927202 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-bb381984-a135-44ae-bc03-67459ba5d615 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:12:53.927202 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:53.927202 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:53.927202 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:53.927202 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:53.927202 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:53.927202 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:53.927202 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:53.927202 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:53.927202 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:53.927202 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:53.927202 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:53.927202 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:53.927202 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:53.927202 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:53.927202 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:53.928135 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:53.928135 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:53.928135 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:53.928135 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:53.928135 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:53.928135 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:53.928135 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:53.928135 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:53.928135 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:53.928135 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:53.928135 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:53.928135 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:53.928135 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:53.928135 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:53.928135 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:53.928135 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:53.928941 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:53.928941 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:53.928941 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:53.928941 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:53.928941 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:53.928941 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:53.928941 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:53.928941 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:53.928941 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:53.928941 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:53.928941 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:12:53.928941 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:12:53.930787 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276d88b-4fc7-4dd0-a877-6698b1e325c5 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:53.931787 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 239/480] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 16:12:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:53.937638 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb381984-a135-44ae-bc03-67459ba5d615 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:54.047608 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276d88b-4fc7-4dd0-a877-6698b1e325c5 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:54.052703 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb381984-a135-44ae-bc03-67459ba5d615 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:54.088886 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc40f0-1eb0-400f-a8bd-e57b7fe32bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:54.089086 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5efa0-35c7-40e4-aa4d-6689107ff036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:54.089515 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc40f0-1eb0-400f-a8bd-e57b7fe32bab None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:54.089616 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5efa0-35c7-40e4-aa4d-6689107ff036 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:54.089804 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc40f0-1eb0-400f-a8bd-e57b7fe32bab None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:54.089898 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5efa0-35c7-40e4-aa4d-6689107ff036 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:54.090083 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc40f0-1eb0-400f-a8bd-e57b7fe32bab None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:54.090187 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5efa0-35c7-40e4-aa4d-6689107ff036 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:54.090798 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc40f0-1eb0-400f-a8bd-e57b7fe32bab None admin] RBAC: Adding query filter params (name=service) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:54.091108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc40f0-1eb0-400f-a8bd-e57b7fe32bab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:54.092666 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc40f0-1eb0-400f-a8bd-e57b7fe32bab None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:54.100879 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 240/481] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 16:12:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:54.101392 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c5efa0-35c7-40e4-aa4d-6689107ff036 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:54.102173 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128397f-f8bd-46da-bca4-ae2eb096a9de None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:54.102473 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128397f-f8bd-46da-bca4-ae2eb096a9de None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:54.102757 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128397f-f8bd-46da-bca4-ae2eb096a9de None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:54.107417 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 241/482] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:54.107417 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128397f-f8bd-46da-bca4-ae2eb096a9de None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:54.111674 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-d6c5efa0-35c7-40e4-aa4d-6689107ff036 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:12:54.111674 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:54.111674 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:54.111674 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:54.111674 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:54.111674 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:54.111674 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:54.111674 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:54.111674 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:54.111674 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:54.111674 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:54.111674 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:54.111674 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:54.111674 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:54.111674 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:54.111674 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:54.112549 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:54.112549 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:54.112549 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:54.112549 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:54.112549 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:54.112549 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:54.112549 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:54.112549 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:54.112549 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:54.112549 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:54.112549 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:54.112549 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:54.112549 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:54.112549 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:54.112549 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:54.112549 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:54.113350 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:54.113350 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:54.113350 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:54.113350 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:54.113350 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:54.113350 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:54.113350 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:54.113350 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:54.113350 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:54.113350 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:54.113350 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:12:54.113350 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:54.113350 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 242/483] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 16:12:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:12:54.114482 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a68861-858c-40c1-b09f-82cfe28a4bca None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:54.114585 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a68861-858c-40c1-b09f-82cfe28a4bca None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:54.114846 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a68861-858c-40c1-b09f-82cfe28a4bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:54.128122 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:54.135541 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-56a68861-858c-40c1-b09f-82cfe28a4bca None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:54.136737 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-56a68861-858c-40c1-b09f-82cfe28a4bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:54.166220 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:54.217373 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 243/484] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:54.218653 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a68861-858c-40c1-b09f-82cfe28a4bca None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:54.229642 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128397f-f8bd-46da-bca4-ae2eb096a9de None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:54.267089 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2e01d-ec82-440c-9d80-8ea2acb66849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:54.267770 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2e01d-ec82-440c-9d80-8ea2acb66849 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:54.268059 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2e01d-ec82-440c-9d80-8ea2acb66849 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:54.268340 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2e01d-ec82-440c-9d80-8ea2acb66849 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:54.280926 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2e01d-ec82-440c-9d80-8ea2acb66849 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:54.282407 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2e01d-ec82-440c-9d80-8ea2acb66849 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:54.297658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-79e2e01d-ec82-440c-9d80-8ea2acb66849 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:12:54.297658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:54.297658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:54.297658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:54.297658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:54.297658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:54.297658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:54.297658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:54.297658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:54.297658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:54.297658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:54.297658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:54.297658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:12:54.297658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:12:54.297658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:12:54.298592 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:12:54.298592 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:54.298592 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:54.298592 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:54.298592 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:54.298592 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:54.298592 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:54.298592 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:54.298592 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:54.298592 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:54.298592 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:54.298592 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:54.298592 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:54.298592 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:54.298592 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:54.298592 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:54.298592 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:54.299760 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:12:54.299760 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:12:54.299760 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:12:54.299760 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:12:54.299760 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 242/485] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:12:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:54.299760 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2e01d-ec82-440c-9d80-8ea2acb66849 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:54.359010 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a68861-858c-40c1-b09f-82cfe28a4bca None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:54.372354 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:54.402056 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd59acf-9d8d-4a43-b9b7-beb09526f1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:54.402682 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd59acf-9d8d-4a43-b9b7-beb09526f1fa None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:54.402972 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd59acf-9d8d-4a43-b9b7-beb09526f1fa None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:54.403254 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd59acf-9d8d-4a43-b9b7-beb09526f1fa None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:54.404010 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd59acf-9d8d-4a43-b9b7-beb09526f1fa None admin] RBAC: Adding query filter params (name=service) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:54.404489 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd59acf-9d8d-4a43-b9b7-beb09526f1fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:54.405729 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd59acf-9d8d-4a43-b9b7-beb09526f1fa None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:54.413333 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2e01d-ec82-440c-9d80-8ea2acb66849 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:54.414699 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 244/486] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 16:12:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:54.415470 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd59acf-9d8d-4a43-b9b7-beb09526f1fa None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:54.445588 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:54.455157 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a6887-c024-4ea5-8612-1642f214bca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:54.455859 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a6887-c024-4ea5-8612-1642f214bca6 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:54.456128 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a6887-c024-4ea5-8612-1642f214bca6 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:54.456419 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a6887-c024-4ea5-8612-1642f214bca6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:54.468114 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a6887-c024-4ea5-8612-1642f214bca6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:54.473623 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-830a6887-c024-4ea5-8612-1642f214bca6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:12:54.473623 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:54.473623 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:54.473623 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:54.473623 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:54.473623 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:54.473623 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:54.473623 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:54.473623 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:54.473623 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:54.473623 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:54.473623 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:54.473623 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:54.473623 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:54.473623 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:54.473623 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:54.474690 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:54.474690 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:54.474690 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:54.474690 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:54.474690 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:54.474690 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:54.474690 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:54.474690 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:54.474690 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:54.474690 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:54.474690 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:54.474690 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:54.474690 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:54.474690 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:54.474690 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:54.474690 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:54.475505 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:54.475505 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:54.475505 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:54.475505 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:54.475505 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:54.475505 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:54.475505 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:54.475505 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:54.475505 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:54.475505 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:54.475505 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:12:54.475505 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:12:54.475505 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 243/487] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 16:12:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:54.476164 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a6887-c024-4ea5-8612-1642f214bca6 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:54.525499 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd59acf-9d8d-4a43-b9b7-beb09526f1fa None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:54.558639 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9715a8f-4359-41fe-ac9c-b8e6b011c74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:54.559252 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9715a8f-4359-41fe-ac9c-b8e6b011c74d None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:54.559560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9715a8f-4359-41fe-ac9c-b8e6b011c74d None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:54.559836 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9715a8f-4359-41fe-ac9c-b8e6b011c74d None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:54.561000 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9715a8f-4359-41fe-ac9c-b8e6b011c74d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:54.561478 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9715a8f-4359-41fe-ac9c-b8e6b011c74d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:54.563446 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9715a8f-4359-41fe-ac9c-b8e6b011c74d None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:54.579165 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a6887-c024-4ea5-8612-1642f214bca6 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:54.580853 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 245/488] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:54.582090 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33246a3-f930-4009-8925-eb11507ece5b None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:54.582384 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33246a3-f930-4009-8925-eb11507ece5b None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:54.582664 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33246a3-f930-4009-8925-eb11507ece5b None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:54.588830 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 246/489] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:54.589526 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33246a3-f930-4009-8925-eb11507ece5b None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:54.603552 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:54.615156 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6966835-7526-4cf5-a092-2182237e233a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:54.615832 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6966835-7526-4cf5-a092-2182237e233a None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:54.616119 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6966835-7526-4cf5-a092-2182237e233a None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:54.616394 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6966835-7526-4cf5-a092-2182237e233a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:54.627484 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6966835-7526-4cf5-a092-2182237e233a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:54.628880 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6966835-7526-4cf5-a092-2182237e233a None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:54.642889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-f6966835-7526-4cf5-a092-2182237e233a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:12:54.642889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:54.642889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:54.642889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:54.642889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:54.642889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:54.642889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:54.642889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:54.642889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:54.642889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:54.642889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:54.642889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:54.642889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:12:54.642889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:12:54.642889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:12:54.643835 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:12:54.643835 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:54.643835 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:54.643835 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:54.643835 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:54.643835 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:54.643835 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:54.643835 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:54.643835 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:54.643835 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:54.643835 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:54.643835 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:54.643835 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:54.643835 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:54.643835 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:54.643835 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:54.643835 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:54.644674 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:12:54.644674 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:12:54.644674 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:12:54.644674 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:12:54.644674 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 244/490] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:12:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:54.644946 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6966835-7526-4cf5-a092-2182237e233a None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:54.683588 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:54.702265 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33246a3-f930-4009-8925-eb11507ece5b None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:54.736834 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a29afe-2d41-4f69-a94c-e09e5d72d5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:54.737449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a29afe-2d41-4f69-a94c-e09e5d72d5d9 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:54.737735 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a29afe-2d41-4f69-a94c-e09e5d72d5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:54.738014 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a29afe-2d41-4f69-a94c-e09e5d72d5d9 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:54.738732 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a29afe-2d41-4f69-a94c-e09e5d72d5d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:54.739041 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a29afe-2d41-4f69-a94c-e09e5d72d5d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:54.740484 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a29afe-2d41-4f69-a94c-e09e5d72d5d9 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:54.748489 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6966835-7526-4cf5-a092-2182237e233a None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:54.748650 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 247/491] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 16:12:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:54.750424 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db7515-6674-4a35-8d2e-29edf639732a None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:54.750715 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db7515-6674-4a35-8d2e-29edf639732a None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:54.750997 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db7515-6674-4a35-8d2e-29edf639732a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:54.770357 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-b3db7515-6674-4a35-8d2e-29edf639732a None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:54.772014 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-b3db7515-6674-4a35-8d2e-29edf639732a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:54.794332 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5d17a-8e7c-47a3-9cdf-f604bbc72670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:54.799325 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5d17a-8e7c-47a3-9cdf-f604bbc72670 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:54.799325 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5d17a-8e7c-47a3-9cdf-f604bbc72670 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:54.799325 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5d17a-8e7c-47a3-9cdf-f604bbc72670 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:54.804523 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5d17a-8e7c-47a3-9cdf-f604bbc72670 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:54.805991 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5d17a-8e7c-47a3-9cdf-f604bbc72670 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:54.818997 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-05d5d17a-8e7c-47a3-9cdf-f604bbc72670 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 16:12:54.818997 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:54.818997 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:54.818997 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:54.818997 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:54.818997 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:54.818997 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:54.818997 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:54.818997 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:54.818997 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:54.818997 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:54.818997 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:54.818997 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:12:54.818997 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:12:54.818997 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:12:54.818997 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:12:54.819954 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:54.819954 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:54.819954 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:12:54.819954 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:12:54.819954 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:12:54.819954 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:12:54.819954 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:54.819954 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:54.819954 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:54.819954 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:54.819954 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:54.819954 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:54.819954 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:54.819954 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:54.819954 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:54.819954 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:54.819954 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:54.819954 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:54.820833 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:54.820833 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:54.820833 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:12:54.820833 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:12:54.820833 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:12:54.820833 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:12:54.820833 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:12:54.820833 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:12:54.820833 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 16:12:54.820833 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:12:54.820833 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 245/492] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Jul 27 16:12:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:54.821374 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5d17a-8e7c-47a3-9cdf-f604bbc72670 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:54.847749 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 248/493] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:54.848611 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db7515-6674-4a35-8d2e-29edf639732a None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:54.857670 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:54.927149 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:54.931302 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5d17a-8e7c-47a3-9cdf-f604bbc72670 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:54.949328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db7515-6674-4a35-8d2e-29edf639732a None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:54.964881 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938719b6-7b85-4a8f-956d-5ace59793e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:54.965510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938719b6-7b85-4a8f-956d-5ace59793e95 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:54.965798 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938719b6-7b85-4a8f-956d-5ace59793e95 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:54.966088 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938719b6-7b85-4a8f-956d-5ace59793e95 None admin] PATH_INFO: `/v3/domains` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:54.966773 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938719b6-7b85-4a8f-956d-5ace59793e95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:54.967082 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938719b6-7b85-4a8f-956d-5ace59793e95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:54.969047 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938719b6-7b85-4a8f-956d-5ace59793e95 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:54.981510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 246/494] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:54.982481 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938719b6-7b85-4a8f-956d-5ace59793e95 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:54.982657 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b2c10-7233-4b05-b204-ec1625bdc92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:54.983154 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b2c10-7233-4b05-b204-ec1625bdc92d None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:54.983568 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b2c10-7233-4b05-b204-ec1625bdc92d None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:54.984430 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b2c10-7233-4b05-b204-ec1625bdc92d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:54.994460 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b2c10-7233-4b05-b204-ec1625bdc92d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:54.995948 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b2c10-7233-4b05-b204-ec1625bdc92d None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:55.010219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-012b2c10-7233-4b05-b204-ec1625bdc92d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:12:55.010219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:55.010219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:55.010219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:55.010219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:55.010219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:55.010219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:55.010219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:55.010219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:55.010219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:55.010219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:55.010219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:55.010219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:12:55.010219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:12:55.010219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:12:55.011402 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:12:55.011402 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:55.011402 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:55.011402 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:55.011402 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:55.011402 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:55.011402 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:55.011402 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:55.011402 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:55.011402 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:55.011402 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:55.011402 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:55.011402 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:55.011402 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:55.011402 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:55.011402 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:55.011402 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:55.012280 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:12:55.012280 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:12:55.012280 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:12:55.012280 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:55.012280 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 249/495] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:12:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:55.012280 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b2c10-7233-4b05-b204-ec1625bdc92d None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:55.085737 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:55.092220 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938719b6-7b85-4a8f-956d-5ace59793e95 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:55.110775 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b2c10-7233-4b05-b204-ec1625bdc92d None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:55.127349 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658443dd-44e5-4ecb-b741-93968bd4f0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:55.128118 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658443dd-44e5-4ecb-b741-93968bd4f0e9 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:55.128406 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658443dd-44e5-4ecb-b741-93968bd4f0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:55.128677 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658443dd-44e5-4ecb-b741-93968bd4f0e9 None admin] PATH_INFO: `/v3/users` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:55.129473 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658443dd-44e5-4ecb-b741-93968bd4f0e9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:55.129777 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658443dd-44e5-4ecb-b741-93968bd4f0e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:55.131234 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658443dd-44e5-4ecb-b741-93968bd4f0e9 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:55.136345 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:55.147680 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522584e-6d24-46ad-ba45-96511cf58fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:55.148340 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522584e-6d24-46ad-ba45-96511cf58fff None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:55.148632 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522584e-6d24-46ad-ba45-96511cf58fff None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:55.148913 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522584e-6d24-46ad-ba45-96511cf58fff None admin] PATH_INFO: `/v3/roles/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:55.162727 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d522584e-6d24-46ad-ba45-96511cf58fff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:12:55.168503 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-d522584e-6d24-46ad-ba45-96511cf58fff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:12:55.168503 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:55.168503 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:55.168503 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:55.168503 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:55.168503 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:55.168503 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:55.168503 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:55.168503 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:55.168503 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:55.168503 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:55.168503 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:55.168503 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:12:55.168503 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:12:55.168503 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:12:55.168503 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:12:55.169462 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:12:55.169462 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:12:55.169462 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:12:55.169462 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:12:55.169462 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:55.169462 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:55.169462 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:55.169462 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:55.169462 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:55.169462 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:55.169462 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:55.169462 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:55.169462 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:55.169462 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:55.169462 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:55.169462 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:55.170301 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:55.170301 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:55.170301 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:55.170301 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:55.170301 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:12:55.170301 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:12:55.170301 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:12:55.170301 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:12:55.170301 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:12:55.170301 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:12:55.170301 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:12:55.170301 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:55.170301 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 250/496] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 16:12:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:55.170953 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522584e-6d24-46ad-ba45-96511cf58fff None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:55.171802 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 247/497] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Jul 27 16:12:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:55.172446 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658443dd-44e5-4ecb-b741-93968bd4f0e9 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:55.272457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522584e-6d24-46ad-ba45-96511cf58fff None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:55.272666 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658443dd-44e5-4ecb-b741-93968bd4f0e9 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:55.307166 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f2b5f-bf91-4705-b7c5-5a46c09d4fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:55.307356 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f6a62-e434-4223-bf27-e3abcae0bb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:55.308338 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f2b5f-bf91-4705-b7c5-5a46c09d4fc9 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:55.308477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f6a62-e434-4223-bf27-e3abcae0bb86 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:55.308563 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f2b5f-bf91-4705-b7c5-5a46c09d4fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:55.308642 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f6a62-e434-4223-bf27-e3abcae0bb86 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:55.308719 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f2b5f-bf91-4705-b7c5-5a46c09d4fc9 None admin] PATH_INFO: `/v3/domains` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:55.308795 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f6a62-e434-4223-bf27-e3abcae0bb86 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:55.309106 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f2b5f-bf91-4705-b7c5-5a46c09d4fc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:55.309418 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f2b5f-bf91-4705-b7c5-5a46c09d4fc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:55.310803 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f2b5f-bf91-4705-b7c5-5a46c09d4fc9 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:55.316002 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f6a62-e434-4223-bf27-e3abcae0bb86 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:55.317453 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f6a62-e434-4223-bf27-e3abcae0bb86 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:55.321987 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 248/498] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:55.322789 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f2b5f-bf91-4705-b7c5-5a46c09d4fc9 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:55.331230 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-372f6a62-e434-4223-bf27-e3abcae0bb86 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 16:12:55.331230 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:55.331230 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:55.331230 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:55.331230 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:55.331230 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:55.331230 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:55.331230 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:55.331230 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:55.331230 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:55.331230 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:55.331230 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:55.331230 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:12:55.331230 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:12:55.331230 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:12:55.331230 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:12:55.332173 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:55.332173 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:55.332173 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:12:55.332173 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:12:55.332173 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:12:55.332173 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:12:55.332173 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:55.332173 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:55.332173 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:55.332173 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:55.332173 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:55.332173 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:55.332173 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:55.332173 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:55.332173 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:55.332173 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:55.332173 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:55.332173 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:55.333062 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:55.333062 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:55.333062 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:12:55.333062 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:12:55.333062 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:12:55.333062 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:12:55.333062 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:12:55.333062 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:12:55.333062 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 16:12:55.333062 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:55.333062 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 251/499] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:55.333631 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f6a62-e434-4223-bf27-e3abcae0bb86 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:55.341887 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:55.386741 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:55.430088 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f2b5f-bf91-4705-b7c5-5a46c09d4fc9 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:55.439404 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f6a62-e434-4223-bf27-e3abcae0bb86 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:55.463599 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404260e-ada8-4b84-bf6b-9413dfda44a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:55.464213 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404260e-ada8-4b84-bf6b-9413dfda44a0 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:55.464493 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404260e-ada8-4b84-bf6b-9413dfda44a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:55.464762 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404260e-ada8-4b84-bf6b-9413dfda44a0 None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:55.465464 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404260e-ada8-4b84-bf6b-9413dfda44a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:55.465766 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404260e-ada8-4b84-bf6b-9413dfda44a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:55.467135 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404260e-ada8-4b84-bf6b-9413dfda44a0 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:55.474462 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d4e77-ccb8-42e2-940d-c43cca14c394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:55.475083 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d4e77-ccb8-42e2-940d-c43cca14c394 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:55.475387 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d4e77-ccb8-42e2-940d-c43cca14c394 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:55.475686 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d4e77-ccb8-42e2-940d-c43cca14c394 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:55.475903 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 249/500] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 16:12:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:55.476719 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404260e-ada8-4b84-bf6b-9413dfda44a0 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:55.562659 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:55.563258 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d4e77-ccb8-42e2-940d-c43cca14c394 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:55.565231 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d4e77-ccb8-42e2-940d-c43cca14c394 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:55.586660 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404260e-ada8-4b84-bf6b-9413dfda44a0 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:55.613256 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:55.620192 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704eb7b0-6310-4481-90b7-d899117df279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:55.620843 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704eb7b0-6310-4481-90b7-d899117df279 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:55.621138 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704eb7b0-6310-4481-90b7-d899117df279 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:55.621404 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704eb7b0-6310-4481-90b7-d899117df279 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:55.629418 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704eb7b0-6310-4481-90b7-d899117df279 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:55.630883 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704eb7b0-6310-4481-90b7-d899117df279 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:55.642738 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-704eb7b0-6310-4481-90b7-d899117df279 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 16:12:55.642738 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:55.642738 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:55.642738 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:55.642738 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:55.642738 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:55.642738 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:55.642738 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:55.642738 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:55.642738 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:55.642738 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:55.642738 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:55.642738 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:12:55.642738 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:12:55.642738 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:12:55.642738 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:12:55.643819 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:55.643819 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:55.643819 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:12:55.643819 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:12:55.643819 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:12:55.643819 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:12:55.643819 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:55.643819 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:55.643819 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:55.643819 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:55.643819 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:55.643819 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:55.643819 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:55.643819 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:55.643819 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:55.643819 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:55.643819 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:55.643819 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:55.644748 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:55.644748 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:55.644748 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:12:55.644748 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:12:55.644748 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:12:55.644748 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:12:55.644748 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:12:55.644748 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:12:55.644748 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 16:12:55.644748 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:12:55.644748 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 250/501] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:12:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:55.644748 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704eb7b0-6310-4481-90b7-d899117df279 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:55.670819 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 252/502] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:12:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:12:55.671880 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d4e77-ccb8-42e2-940d-c43cca14c394 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:55.749473 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704eb7b0-6310-4481-90b7-d899117df279 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:55.775042 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d4e77-ccb8-42e2-940d-c43cca14c394 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:55.783616 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b62e86-12e3-4406-8da9-5f5f858897a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:55.784245 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b62e86-12e3-4406-8da9-5f5f858897a4 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:55.784541 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b62e86-12e3-4406-8da9-5f5f858897a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:55.784820 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b62e86-12e3-4406-8da9-5f5f858897a4 None admin] PATH_INFO: `/v3/users` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:55.785736 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b62e86-12e3-4406-8da9-5f5f858897a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:55.786055 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b62e86-12e3-4406-8da9-5f5f858897a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:55.787521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b62e86-12e3-4406-8da9-5f5f858897a4 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:55.790295 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:55.806204 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 251/503] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Jul 27 16:12:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:55.807035 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b62e86-12e3-4406-8da9-5f5f858897a4 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:55.809610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fbcb8-3ea6-42af-965f-dfdf81cc7793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:55.810464 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fbcb8-3ea6-42af-965f-dfdf81cc7793 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:55.810597 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fbcb8-3ea6-42af-965f-dfdf81cc7793 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:55.810854 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fbcb8-3ea6-42af-965f-dfdf81cc7793 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:55.821483 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353fbcb8-3ea6-42af-965f-dfdf81cc7793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:55.822877 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353fbcb8-3ea6-42af-965f-dfdf81cc7793 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:55.831069 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:55.838234 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-353fbcb8-3ea6-42af-965f-dfdf81cc7793 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:12:55.838234 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:55.838234 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:55.838234 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:55.838234 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:55.838234 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:55.838234 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:55.838234 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:55.838234 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:55.838234 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:55.838234 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:55.838234 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:55.838234 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:12:55.838234 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:12:55.838234 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:12:55.839128 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:12:55.839128 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:55.839128 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:55.839128 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:55.839128 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:55.839128 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:55.839128 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:55.839128 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:55.839128 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:55.839128 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:55.839128 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:55.839128 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:55.839128 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:55.839128 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:55.839128 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:55.839128 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:55.839128 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:55.839981 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:12:55.839981 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:12:55.839981 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:12:55.839981 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:55.839981 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 253/504] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:12:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:55.840665 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fbcb8-3ea6-42af-965f-dfdf81cc7793 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:55.923266 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b62e86-12e3-4406-8da9-5f5f858897a4 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:55.941920 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fbcb8-3ea6-42af-965f-dfdf81cc7793 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:55.958318 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf2d14-9fe2-4be4-b7fd-1391bb2595ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:55.958944 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf2d14-9fe2-4be4-b7fd-1391bb2595ef None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:55.959229 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf2d14-9fe2-4be4-b7fd-1391bb2595ef None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:55.959654 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf2d14-9fe2-4be4-b7fd-1391bb2595ef None admin] PATH_INFO: `/v3/users` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:55.960450 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf2d14-9fe2-4be4-b7fd-1391bb2595ef None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:55.960764 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf2d14-9fe2-4be4-b7fd-1391bb2595ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:55.962214 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf2d14-9fe2-4be4-b7fd-1391bb2595ef None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:55.976646 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57d1ed-c142-42bc-8958-0115f18907ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:55.977659 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57d1ed-c142-42bc-8958-0115f18907ae None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:55.978036 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57d1ed-c142-42bc-8958-0115f18907ae None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:55.978444 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57d1ed-c142-42bc-8958-0115f18907ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:55.980794 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 252/505] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Jul 27 16:12:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:55.981599 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf2d14-9fe2-4be4-b7fd-1391bb2595ef None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:55.991110 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd57d1ed-c142-42bc-8958-0115f18907ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:55.992634 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd57d1ed-c142-42bc-8958-0115f18907ae None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:56.006821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-cd57d1ed-c142-42bc-8958-0115f18907ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:12:56.006821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:56.006821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:56.006821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:56.006821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:56.006821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:56.006821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:56.006821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:56.006821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:56.006821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:56.006821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:56.006821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:56.006821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:12:56.006821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:12:56.006821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:12:56.007826 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:12:56.007826 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:56.007826 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:56.007826 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:56.007826 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:56.007826 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:56.007826 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:56.007826 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:56.007826 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:56.007826 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:56.007826 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:56.007826 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:56.007826 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:56.007826 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:56.007826 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:56.007826 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:56.007826 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:56.008682 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:12:56.008682 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:12:56.008682 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:12:56.008682 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:56.008682 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 254/506] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:12:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:56.008937 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57d1ed-c142-42bc-8958-0115f18907ae None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:56.039859 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:56.062219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:56.090946 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf2d14-9fe2-4be4-b7fd-1391bb2595ef None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:56.109776 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57d1ed-c142-42bc-8958-0115f18907ae None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:56.124725 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37434ef9-4cdb-4b45-a46f-478ed636a834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:56.125348 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37434ef9-4cdb-4b45-a46f-478ed636a834 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:56.125639 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37434ef9-4cdb-4b45-a46f-478ed636a834 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:56.125919 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37434ef9-4cdb-4b45-a46f-478ed636a834 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:56.143564 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095862a-07d7-4255-98cf-c10cd27a599e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:56.144182 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095862a-07d7-4255-98cf-c10cd27a599e None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:56.144482 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095862a-07d7-4255-98cf-c10cd27a599e None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:56.144753 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095862a-07d7-4255-98cf-c10cd27a599e None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:56.145471 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095862a-07d7-4255-98cf-c10cd27a599e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:56.145781 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095862a-07d7-4255-98cf-c10cd27a599e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:56.147200 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095862a-07d7-4255-98cf-c10cd27a599e None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:56.159408 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 255/507] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:56.160209 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095862a-07d7-4255-98cf-c10cd27a599e None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:56.208460 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37434ef9-4cdb-4b45-a46f-478ed636a834 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:56.211126 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37434ef9-4cdb-4b45-a46f-478ed636a834 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:56.266363 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095862a-07d7-4255-98cf-c10cd27a599e None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:56.267975 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:56.280369 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:56.303339 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafba48-16c3-41a7-8c1e-1a667ce9d70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:56.303997 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafba48-16c3-41a7-8c1e-1a667ce9d70a None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:56.304278 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafba48-16c3-41a7-8c1e-1a667ce9d70a None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:56.304552 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafba48-16c3-41a7-8c1e-1a667ce9d70a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:56.316639 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 253/508] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:12:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:12:56.317597 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37434ef9-4cdb-4b45-a46f-478ed636a834 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:56.372507 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deafba48-16c3-41a7-8c1e-1a667ce9d70a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:56.373988 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deafba48-16c3-41a7-8c1e-1a667ce9d70a None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:56.417636 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37434ef9-4cdb-4b45-a46f-478ed636a834 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:56.453066 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e18e4c-2d16-460e-9bf2-85cdcd1fb960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:56.453709 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e18e4c-2d16-460e-9bf2-85cdcd1fb960 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:56.453992 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e18e4c-2d16-460e-9bf2-85cdcd1fb960 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:56.454262 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e18e4c-2d16-460e-9bf2-85cdcd1fb960 None admin] PATH_INFO: `/v3/domains` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:56.454953 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e18e4c-2d16-460e-9bf2-85cdcd1fb960 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:56.455259 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e18e4c-2d16-460e-9bf2-85cdcd1fb960 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:56.456664 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e18e4c-2d16-460e-9bf2-85cdcd1fb960 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:56.467828 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 254/509] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:56.468741 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e18e4c-2d16-460e-9bf2-85cdcd1fb960 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:56.473469 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 256/510] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:12:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:12:56.474292 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafba48-16c3-41a7-8c1e-1a667ce9d70a None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:56.483813 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:56.489479 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:56.572727 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e18e4c-2d16-460e-9bf2-85cdcd1fb960 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:56.582194 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafba48-16c3-41a7-8c1e-1a667ce9d70a None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:56.607978 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1688b13-d6ca-4c6d-8cb2-d19252b402c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:56.608616 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1688b13-d6ca-4c6d-8cb2-d19252b402c3 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:56.608898 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1688b13-d6ca-4c6d-8cb2-d19252b402c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:56.609173 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1688b13-d6ca-4c6d-8cb2-d19252b402c3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:56.614853 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605399b4-c184-4ef2-af48-cb4d8484f443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:56.615524 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605399b4-c184-4ef2-af48-cb4d8484f443 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:56.615806 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605399b4-c184-4ef2-af48-cb4d8484f443 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:56.616078 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605399b4-c184-4ef2-af48-cb4d8484f443 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:56.616598 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1688b13-d6ca-4c6d-8cb2-d19252b402c3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:56.618016 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1688b13-d6ca-4c6d-8cb2-d19252b402c3 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:56.626441 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605399b4-c184-4ef2-af48-cb4d8484f443 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:56.627860 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605399b4-c184-4ef2-af48-cb4d8484f443 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:56.629558 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-b1688b13-d6ca-4c6d-8cb2-d19252b402c3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 16:12:56.629558 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:56.629558 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:56.629558 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:56.629558 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:56.629558 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:56.629558 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:56.629558 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:56.629558 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:56.629558 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:56.629558 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:56.629558 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:56.629558 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:12:56.629558 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:12:56.629558 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:12:56.629558 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:12:56.630926 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:56.630926 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:56.630926 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:12:56.630926 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:12:56.630926 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:12:56.630926 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:12:56.630926 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:56.630926 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:56.630926 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:56.630926 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:56.630926 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:56.630926 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:56.630926 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:56.630926 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:56.630926 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:56.630926 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:56.630926 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:56.630926 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:56.632036 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:56.632036 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:56.632036 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:12:56.632036 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:12:56.632036 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:12:56.632036 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:12:56.632036 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:12:56.632036 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:12:56.632036 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 16:12:56.632036 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:12:56.635523 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 255/511] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 16:12:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:56.636354 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1688b13-d6ca-4c6d-8cb2-d19252b402c3 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:56.643321 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-605399b4-c184-4ef2-af48-cb4d8484f443 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:12:56.643321 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:56.643321 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:56.643321 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:56.643321 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:56.643321 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:56.643321 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:56.643321 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:56.643321 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:56.643321 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:56.643321 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:56.643321 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:56.643321 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:12:56.643321 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:12:56.643321 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:12:56.644319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:12:56.644319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:56.644319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:56.644319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:56.644319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:56.644319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:56.644319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:56.644319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:56.644319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:56.644319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:56.644319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:56.644319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:56.644319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:56.644319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:56.644319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:56.644319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:56.644319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:56.645357 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:12:56.645357 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:12:56.645357 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:12:56.645357 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:56.647928 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 257/512] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:12:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:56.648557 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605399b4-c184-4ef2-af48-cb4d8484f443 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:56.708936 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:56.716529 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:56.739837 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1688b13-d6ca-4c6d-8cb2-d19252b402c3 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:56.755528 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605399b4-c184-4ef2-af48-cb4d8484f443 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:56.773646 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f298b0-423e-41fc-aa76-8c0abcbad8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:56.774286 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f298b0-423e-41fc-aa76-8c0abcbad8c9 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:56.774571 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f298b0-423e-41fc-aa76-8c0abcbad8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:56.774847 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f298b0-423e-41fc-aa76-8c0abcbad8c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:56.784727 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f298b0-423e-41fc-aa76-8c0abcbad8c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:56.786197 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f298b0-423e-41fc-aa76-8c0abcbad8c9 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:56.789474 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da807d-6e46-4fe6-b832-3208e4dbabff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:56.790151 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da807d-6e46-4fe6-b832-3208e4dbabff None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:56.790440 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da807d-6e46-4fe6-b832-3208e4dbabff None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:56.790717 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da807d-6e46-4fe6-b832-3208e4dbabff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:56.798956 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-b3f298b0-423e-41fc-aa76-8c0abcbad8c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:12:56.798956 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:56.798956 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:56.798956 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:56.798956 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:56.798956 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:56.798956 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:56.798956 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:56.798956 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:56.798956 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:56.798956 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:56.798956 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:56.798956 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:12:56.798956 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:12:56.798956 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:12:56.799993 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:12:56.799993 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:56.799993 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:56.799993 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:56.799993 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:56.799993 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:56.799993 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:56.799993 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:56.799993 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:56.799993 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:56.799993 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:56.799993 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:56.799993 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:56.799993 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:56.799993 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:56.799993 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:56.799993 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:56.800846 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:12:56.800846 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:12:56.800846 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:12:56.800846 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:12:56.800846 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:12:56.800846 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:12:56.800846 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:12:56.800846 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:12:56.800846 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 256/513] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:12:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:56.801297 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f298b0-423e-41fc-aa76-8c0abcbad8c9 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:56.803931 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da807d-6e46-4fe6-b832-3208e4dbabff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:56.805505 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da807d-6e46-4fe6-b832-3208e4dbabff None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:56.820610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-c2da807d-6e46-4fe6-b832-3208e4dbabff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:12:56.820610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:56.820610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:56.820610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:56.820610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:56.820610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:56.820610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:56.820610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:56.820610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:56.820610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:56.820610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:56.820610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:56.820610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:12:56.820610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:12:56.820610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:12:56.821452 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:12:56.821452 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:56.821452 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:56.821452 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:56.821452 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:56.821452 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:56.821452 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:56.821452 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:56.821452 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:56.821452 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:56.821452 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:56.821452 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:56.821452 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:56.821452 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:56.821452 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:56.821452 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:56.821452 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:56.822322 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:12:56.822322 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:12:56.822322 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:12:56.822322 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:56.822322 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 258/514] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:12:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:56.822608 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da807d-6e46-4fe6-b832-3208e4dbabff None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:56.904570 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f298b0-423e-41fc-aa76-8c0abcbad8c9 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:56.922777 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da807d-6e46-4fe6-b832-3208e4dbabff None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:56.933820 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:56.939959 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e7125-557b-491a-a94c-2d6bfd762679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:56.940403 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:56.940611 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e7125-557b-491a-a94c-2d6bfd762679 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:56.940898 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e7125-557b-491a-a94c-2d6bfd762679 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:56.941177 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e7125-557b-491a-a94c-2d6bfd762679 None admin] PATH_INFO: `/v3/users` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:56.942013 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e7125-557b-491a-a94c-2d6bfd762679 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:56.942318 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e7125-557b-491a-a94c-2d6bfd762679 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:56.943772 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e7125-557b-491a-a94c-2d6bfd762679 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:56.958759 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf551fc3-03d1-4494-9aa3-1b94c0e1bd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:56.959390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf551fc3-03d1-4494-9aa3-1b94c0e1bd36 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:56.959693 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf551fc3-03d1-4494-9aa3-1b94c0e1bd36 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:56.959969 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf551fc3-03d1-4494-9aa3-1b94c0e1bd36 None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:56.960656 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf551fc3-03d1-4494-9aa3-1b94c0e1bd36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:56.960962 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf551fc3-03d1-4494-9aa3-1b94c0e1bd36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:56.961252 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 257/515] 10.222.0.65 () {56 vars in 1139 bytes} [Wed Jul 27 16:12:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:56.962072 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e7125-557b-491a-a94c-2d6bfd762679 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:56.962347 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf551fc3-03d1-4494-9aa3-1b94c0e1bd36 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:56.974473 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 259/516] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:56.975316 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf551fc3-03d1-4494-9aa3-1b94c0e1bd36 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:57.063613 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e7125-557b-491a-a94c-2d6bfd762679 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:57.074635 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf551fc3-03d1-4494-9aa3-1b94c0e1bd36 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:57.097548 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d65ec9-3dd5-43a1-8106-49ef3920a331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:57.098166 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d65ec9-3dd5-43a1-8106-49ef3920a331 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:57.098451 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d65ec9-3dd5-43a1-8106-49ef3920a331 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:57.098724 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d65ec9-3dd5-43a1-8106-49ef3920a331 None admin] PATH_INFO: `/v3/projects` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:57.099496 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d65ec9-3dd5-43a1-8106-49ef3920a331 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:57.099807 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d65ec9-3dd5-43a1-8106-49ef3920a331 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:57.101244 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d65ec9-3dd5-43a1-8106-49ef3920a331 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:57.108247 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14171cc-3f36-449f-b9fe-6f31dd3248e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:57.108897 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14171cc-3f36-449f-b9fe-6f31dd3248e8 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:57.109181 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14171cc-3f36-449f-b9fe-6f31dd3248e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:57.109458 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14171cc-3f36-449f-b9fe-6f31dd3248e8 None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:57.110149 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14171cc-3f36-449f-b9fe-6f31dd3248e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:57.110459 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14171cc-3f36-449f-b9fe-6f31dd3248e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:57.111868 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14171cc-3f36-449f-b9fe-6f31dd3248e8 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:57.119173 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 258/517] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 16:12:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:57.120033 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d65ec9-3dd5-43a1-8106-49ef3920a331 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:57.123088 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 260/518] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:57.124140 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14171cc-3f36-449f-b9fe-6f31dd3248e8 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:57.163659 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:57.175485 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:57.231022 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d65ec9-3dd5-43a1-8106-49ef3920a331 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:57.233449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14171cc-3f36-449f-b9fe-6f31dd3248e8 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:57.265400 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6df0b4-edc5-4d49-ab7c-631fe2e13c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:57.266019 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6df0b4-edc5-4d49-ab7c-631fe2e13c71 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:57.266302 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6df0b4-edc5-4d49-ab7c-631fe2e13c71 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:57.266390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b48507-50e5-4479-91de-922d3335bd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:57.266579 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6df0b4-edc5-4d49-ab7c-631fe2e13c71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:57.266978 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b48507-50e5-4479-91de-922d3335bd50 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:57.267265 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b48507-50e5-4479-91de-922d3335bd50 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:57.267585 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b48507-50e5-4479-91de-922d3335bd50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:57.274366 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b48507-50e5-4479-91de-922d3335bd50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:57.276111 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b48507-50e5-4479-91de-922d3335bd50 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:57.288675 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-b7b48507-50e5-4479-91de-922d3335bd50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:12:57.288675 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:57.288675 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:57.288675 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:57.288675 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:57.288675 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:57.288675 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:57.288675 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:57.288675 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:57.288675 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:57.288675 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:57.288675 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:57.288675 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:12:57.288675 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:12:57.288675 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:12:57.289959 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:12:57.289959 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:57.289959 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:57.289959 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:57.289959 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:57.289959 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:57.289959 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:57.289959 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:57.289959 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:57.289959 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:57.289959 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:57.289959 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:57.289959 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:57.289959 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:57.289959 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:57.289959 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:57.289959 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:57.291271 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:12:57.291271 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:12:57.291271 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:12:57.291271 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:12:57.291271 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:12:57.291271 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:12:57.291271 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:12:57.291271 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:57.291271 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 261/519] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:12:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:57.291271 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b48507-50e5-4479-91de-922d3335bd50 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:57.342952 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6df0b4-edc5-4d49-ab7c-631fe2e13c71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:57.344444 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6df0b4-edc5-4d49-ab7c-631fe2e13c71 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:57.386068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:57.394042 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b48507-50e5-4479-91de-922d3335bd50 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:57.394447 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:57.428555 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0436447-e7bf-4bd8-9ebb-3426bab75cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:57.429098 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0436447-e7bf-4bd8-9ebb-3426bab75cf5 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:57.429380 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0436447-e7bf-4bd8-9ebb-3426bab75cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:57.429653 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0436447-e7bf-4bd8-9ebb-3426bab75cf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:57.430438 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0436447-e7bf-4bd8-9ebb-3426bab75cf5 None admin] RBAC: Adding query filter params (role.id=738aa511871f47acb7169da7e104be79, scope.project.id=73d63a3d7b724a5998ea2976430f242d, user.id=66768f9443c046b3bd75853a4b2b980e) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:57.430748 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0436447-e7bf-4bd8-9ebb-3426bab75cf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:57.432693 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0436447-e7bf-4bd8-9ebb-3426bab75cf5 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:57.438149 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 262/520] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 16:12:57 2022] GET /identity/v3/role_assignments?user.id=66768f9443c046b3bd75853a4b2b980e&scope.project.id=73d63a3d7b724a5998ea2976430f242d&role.id=738aa511871f47acb7169da7e104be79 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:57.438933 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0436447-e7bf-4bd8-9ebb-3426bab75cf5 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:57.451177 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 259/521] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:12:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:12:57.451177 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6df0b4-edc5-4d49-ab7c-631fe2e13c71 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:57.559592 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0436447-e7bf-4bd8-9ebb-3426bab75cf5 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:57.564978 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6df0b4-edc5-4d49-ab7c-631fe2e13c71 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:57.599987 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a48199-1bb6-4775-84a8-7850c459d39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:57.600654 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a48199-1bb6-4775-84a8-7850c459d39f None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:57.600941 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a48199-1bb6-4775-84a8-7850c459d39f None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:57.601219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a48199-1bb6-4775-84a8-7850c459d39f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:57.603707 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e67cab-48d5-41d3-82ec-cbe7a245b1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:57.604351 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e67cab-48d5-41d3-82ec-cbe7a245b1b2 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:57.604638 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e67cab-48d5-41d3-82ec-cbe7a245b1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:57.604917 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e67cab-48d5-41d3-82ec-cbe7a245b1b2 None admin] PATH_INFO: `/v3/projects` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:57.605703 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e67cab-48d5-41d3-82ec-cbe7a245b1b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:57.606047 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e67cab-48d5-41d3-82ec-cbe7a245b1b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:57.607540 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e67cab-48d5-41d3-82ec-cbe7a245b1b2 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:57.610199 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a48199-1bb6-4775-84a8-7850c459d39f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:57.611707 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a48199-1bb6-4775-84a8-7850c459d39f None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:57.622608 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 260/522] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 16:12:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:57.623552 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e67cab-48d5-41d3-82ec-cbe7a245b1b2 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:57.624213 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-97a48199-1bb6-4775-84a8-7850c459d39f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:12:57.624213 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:57.624213 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:57.624213 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:57.624213 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:57.624213 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:57.624213 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:57.624213 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:57.624213 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:57.624213 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:57.624213 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:57.624213 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:57.624213 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:12:57.624213 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:12:57.624213 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:12:57.625746 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:12:57.625746 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:57.625746 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:57.625746 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:57.625746 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:57.625746 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:57.625746 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:57.625746 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:57.625746 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:57.625746 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:57.625746 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:57.625746 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:57.625746 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:57.625746 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:57.625746 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:57.625746 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:57.625746 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:57.640355 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:12:57.640355 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:12:57.640355 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:12:57.640355 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:12:57.640355 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:12:57.640355 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:12:57.640355 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:12:57.640355 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:12:57.640355 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 263/523] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:12:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:57.640355 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a48199-1bb6-4775-84a8-7850c459d39f None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:57.640961 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:57.654587 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:57.745988 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e67cab-48d5-41d3-82ec-cbe7a245b1b2 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:57.750943 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a48199-1bb6-4775-84a8-7850c459d39f None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:57.785095 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8fd9a-5dde-4f0e-8223-d80687921fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:57.785739 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8fd9a-5dde-4f0e-8223-d80687921fcb None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:57.786025 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8fd9a-5dde-4f0e-8223-d80687921fcb None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:57.786497 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8fd9a-5dde-4f0e-8223-d80687921fcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:57.792616 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8861645-2758-4283-ad9e-fd18510ca2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:57.793383 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8861645-2758-4283-ad9e-fd18510ca2aa None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:57.793602 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8861645-2758-4283-ad9e-fd18510ca2aa None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:57.796302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8861645-2758-4283-ad9e-fd18510ca2aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:57.796302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8861645-2758-4283-ad9e-fd18510ca2aa None admin] RBAC: Adding query filter params (role.id=738aa511871f47acb7169da7e104be79, scope.project.id=73d63a3d7b724a5998ea2976430f242d, user.id=43377fb5ab3c4ddfb54b3b2cae8eb351) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:57.796302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8861645-2758-4283-ad9e-fd18510ca2aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:57.797383 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8861645-2758-4283-ad9e-fd18510ca2aa None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:57.801080 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8fd9a-5dde-4f0e-8223-d80687921fcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:57.802729 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8fd9a-5dde-4f0e-8223-d80687921fcb None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:57.803593 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 264/524] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 16:12:57 2022] GET /identity/v3/role_assignments?user.id=43377fb5ab3c4ddfb54b3b2cae8eb351&scope.project.id=73d63a3d7b724a5998ea2976430f242d&role.id=738aa511871f47acb7169da7e104be79 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:12:57.804223 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8861645-2758-4283-ad9e-fd18510ca2aa None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:57.830266 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-fcc8fd9a-5dde-4f0e-8223-d80687921fcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:12:57.830266 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:57.830266 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:57.830266 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:57.830266 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:57.830266 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:57.830266 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:57.830266 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:57.830266 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:57.830266 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:57.830266 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:57.830266 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:57.830266 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:12:57.830266 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:12:57.830266 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:12:57.831352 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:12:57.831352 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:57.831352 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:57.831352 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:57.831352 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:57.831352 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:57.831352 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:57.831352 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:57.831352 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:57.831352 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:57.831352 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:57.831352 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:57.831352 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:57.831352 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:57.831352 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:57.831352 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:57.831352 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:57.832224 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:12:57.832224 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:12:57.832224 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:12:57.832224 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:12:57.833173 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 261/525] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:12:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:12:57.838705 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8fd9a-5dde-4f0e-8223-d80687921fcb None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:57.921377 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:57.932806 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:57.945637 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8861645-2758-4283-ad9e-fd18510ca2aa None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:57.988021 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b52f7-b05c-46ba-9053-49e49dac92d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:57.989014 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b52f7-b05c-46ba-9053-49e49dac92d5 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:57.989305 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b52f7-b05c-46ba-9053-49e49dac92d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:57.989588 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b52f7-b05c-46ba-9053-49e49dac92d5 None admin] PATH_INFO: `/v3/projects` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:57.989703 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8fd9a-5dde-4f0e-8223-d80687921fcb None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:57.990362 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b52f7-b05c-46ba-9053-49e49dac92d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:57.990673 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b52f7-b05c-46ba-9053-49e49dac92d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:57.992164 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b52f7-b05c-46ba-9053-49e49dac92d5 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:58.012918 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 265/526] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 16:12:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:58.019232 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b52f7-b05c-46ba-9053-49e49dac92d5 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:58.036563 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68466455-050d-4980-8768-8b07465030de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:58.037193 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68466455-050d-4980-8768-8b07465030de None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:58.037632 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68466455-050d-4980-8768-8b07465030de None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:58.037917 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68466455-050d-4980-8768-8b07465030de None admin] PATH_INFO: `/v3/domains` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:58.039162 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68466455-050d-4980-8768-8b07465030de None admin] RBAC: Adding query filter params (name=Default) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:58.039509 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68466455-050d-4980-8768-8b07465030de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:58.040900 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68466455-050d-4980-8768-8b07465030de None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:58.057278 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 262/527] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:58.063050 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68466455-050d-4980-8768-8b07465030de None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:58.138311 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b52f7-b05c-46ba-9053-49e49dac92d5 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:58.194214 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89bf87-e779-4ce6-981d-3ce678ea7755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:58.194932 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89bf87-e779-4ce6-981d-3ce678ea7755 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:58.195225 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89bf87-e779-4ce6-981d-3ce678ea7755 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:58.195563 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89bf87-e779-4ce6-981d-3ce678ea7755 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:58.196535 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89bf87-e779-4ce6-981d-3ce678ea7755 None admin] RBAC: Adding query filter params (role.id=738aa511871f47acb7169da7e104be79, scope.project.id=73d63a3d7b724a5998ea2976430f242d, user.id=4b6d1f7acba3415f84c2f01b66190b8a) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:58.196860 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89bf87-e779-4ce6-981d-3ce678ea7755 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:58.198317 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89bf87-e779-4ce6-981d-3ce678ea7755 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:58.203384 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68466455-050d-4980-8768-8b07465030de None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:58.205384 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 266/528] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 16:12:58 2022] GET /identity/v3/role_assignments?user.id=4b6d1f7acba3415f84c2f01b66190b8a&scope.project.id=73d63a3d7b724a5998ea2976430f242d&role.id=738aa511871f47acb7169da7e104be79 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:58.230669 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:58.244556 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef6f4e-1138-41f3-8291-4a03ca104490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:58.245476 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef6f4e-1138-41f3-8291-4a03ca104490 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:58.245934 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef6f4e-1138-41f3-8291-4a03ca104490 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:58.246371 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef6f4e-1138-41f3-8291-4a03ca104490 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:58.255212 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef6f4e-1138-41f3-8291-4a03ca104490 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:58.257002 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef6f4e-1138-41f3-8291-4a03ca104490 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:58.270290 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-89ef6f4e-1138-41f3-8291-4a03ca104490 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:12:58.270290 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:12:58.270290 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:12:58.270290 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:12:58.270290 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:12:58.270290 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:12:58.270290 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:12:58.270290 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:12:58.270290 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:12:58.270290 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:12:58.270290 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:12:58.270290 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:12:58.270290 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:12:58.270290 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:12:58.270290 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:12:58.271501 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:12:58.271501 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:12:58.271501 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:12:58.271501 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:12:58.271501 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:12:58.271501 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:12:58.271501 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:12:58.271501 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:12:58.271501 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:12:58.271501 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:12:58.271501 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:12:58.271501 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:12:58.271501 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:12:58.271501 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:12:58.271501 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:12:58.271501 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:12:58.271501 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:12:58.272579 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:12:58.272579 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:12:58.272579 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:12:58.272579 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:12:58.272579 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:12:58.272579 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:12:58.272579 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:12:58.272579 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:12:58.274860 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 263/529] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:12:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:12:58.280828 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89bf87-e779-4ce6-981d-3ce678ea7755 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:58.294199 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:58.404131 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89bf87-e779-4ce6-981d-3ce678ea7755 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:58.440052 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee02f7-e3c4-46f9-9ea6-128e7433fc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:58.440676 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee02f7-e3c4-46f9-9ea6-128e7433fc0c None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:58.440962 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee02f7-e3c4-46f9-9ea6-128e7433fc0c None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:58.441243 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee02f7-e3c4-46f9-9ea6-128e7433fc0c None admin] PATH_INFO: `/v3/projects` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:58.441996 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee02f7-e3c4-46f9-9ea6-128e7433fc0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:58.442312 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee02f7-e3c4-46f9-9ea6-128e7433fc0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:58.443941 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee02f7-e3c4-46f9-9ea6-128e7433fc0c None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:58.457456 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 267/530] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 16:12:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:58.463550 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef6f4e-1138-41f3-8291-4a03ca104490 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:58.578499 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef6f4e-1138-41f3-8291-4a03ca104490 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:12:58.615161 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b989bf-8dda-40d4-a3d3-34ce96fa976c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:12:58.616145 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b989bf-8dda-40d4-a3d3-34ce96fa976c None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:58.617626 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b989bf-8dda-40d4-a3d3-34ce96fa976c None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:58.618105 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b989bf-8dda-40d4-a3d3-34ce96fa976c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:58.619090 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b989bf-8dda-40d4-a3d3-34ce96fa976c None admin] RBAC: Adding query filter params (role.id=738aa511871f47acb7169da7e104be79, scope.project.id=73d63a3d7b724a5998ea2976430f242d, user.id=6a95bd511e264733bf7ea71b28ad96ab) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:12:58.619653 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b989bf-8dda-40d4-a3d3-34ce96fa976c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:12:58.621271 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b989bf-8dda-40d4-a3d3-34ce96fa976c None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:12:58.627805 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 264/531] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 16:12:58 2022] GET /identity/v3/role_assignments?user.id=6a95bd511e264733bf7ea71b28ad96ab&scope.project.id=73d63a3d7b724a5998ea2976430f242d&role.id=738aa511871f47acb7169da7e104be79 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:12:59.766776 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8a829-67cc-4b77-b5ca-c20e84461b5b None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:59.767756 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8a829-67cc-4b77-b5ca-c20e84461b5b None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:59.768241 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8a829-67cc-4b77-b5ca-c20e84461b5b None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:59.770180 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 268/532] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:12:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:12:59.776129 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc642866-4f57-40bc-aa99-f9f1a16591b5 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:12:59.777071 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc642866-4f57-40bc-aa99-f9f1a16591b5 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:12:59.777630 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc642866-4f57-40bc-aa99-f9f1a16591b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:12:59.797397 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-dc642866-4f57-40bc-aa99-f9f1a16591b5 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:12:59.798912 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-dc642866-4f57-40bc-aa99-f9f1a16591b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:12:59.847139 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:12:59.876383 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 265/533] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:12:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:12:59.900316 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8a829-67cc-4b77-b5ca-c20e84461b5b None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:12:59.977973 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:00.015042 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8a829-67cc-4b77-b5ca-c20e84461b5b None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:00.052415 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a2ddb-098c-46c9-9f92-db762d9827c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:00.053064 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a2ddb-098c-46c9-9f92-db762d9827c2 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:00.053349 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a2ddb-098c-46c9-9f92-db762d9827c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:00.053631 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a2ddb-098c-46c9-9f92-db762d9827c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:00.065093 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a2ddb-098c-46c9-9f92-db762d9827c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:13:00.070025 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-d33a2ddb-098c-46c9-9f92-db762d9827c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:13:00.070025 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:00.070025 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:00.070025 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:00.070025 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:00.070025 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:00.070025 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:00.070025 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:00.070025 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:00.070025 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:00.070025 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:00.070025 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:00.070025 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:13:00.070025 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:13:00.070025 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:13:00.070025 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:13:00.070925 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:13:00.070925 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:13:00.070925 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:13:00.070925 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:13:00.070925 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:00.070925 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:00.070925 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:00.070925 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:00.070925 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:00.070925 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:00.070925 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:00.070925 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:00.070925 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:00.070925 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:00.070925 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:00.070925 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:00.071760 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:00.071760 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:00.071760 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:00.071760 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:00.071760 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:13:00.071760 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:13:00.071760 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:13:00.071760 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:13:00.071760 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:13:00.071760 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:13:00.071760 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:13:00.071760 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:00.071760 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 269/534] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 16:12:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:00.078239 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc642866-4f57-40bc-aa99-f9f1a16591b5 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:00.105662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aba6ed-9061-46a2-846d-24929cc68713 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:00.105984 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aba6ed-9061-46a2-846d-24929cc68713 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:00.106231 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aba6ed-9061-46a2-846d-24929cc68713 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:00.107646 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 270/535] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:13:00.113143 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c6253-d1e9-436f-b22d-3c1463f3db7c None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:00.113430 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c6253-d1e9-436f-b22d-3c1463f3db7c None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:00.113708 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c6253-d1e9-436f-b22d-3c1463f3db7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:00.135491 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-537c6253-d1e9-436f-b22d-3c1463f3db7c None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:00.136690 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-537c6253-d1e9-436f-b22d-3c1463f3db7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:00.184559 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc642866-4f57-40bc-aa99-f9f1a16591b5 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:00.212760 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 271/536] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:13:00.223643 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ffab6-a1f3-4b38-8c2a-a241da298131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:00.224271 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ffab6-a1f3-4b38-8c2a-a241da298131 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:00.224557 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ffab6-a1f3-4b38-8c2a-a241da298131 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:00.224834 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ffab6-a1f3-4b38-8c2a-a241da298131 None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:00.225551 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ffab6-a1f3-4b38-8c2a-a241da298131 None admin] RBAC: Adding query filter params (name=service) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:00.225856 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ffab6-a1f3-4b38-8c2a-a241da298131 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:00.227222 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ffab6-a1f3-4b38-8c2a-a241da298131 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:00.236749 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c6253-d1e9-436f-b22d-3c1463f3db7c None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:00.239468 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 266/537] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 16:13:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:00.242891 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ffab6-a1f3-4b38-8c2a-a241da298131 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:00.302386 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:00.304952 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:00.350601 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c6253-d1e9-436f-b22d-3c1463f3db7c None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:00.390708 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d0858-8b9e-4f50-920f-582f1844b844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:00.391699 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d0858-8b9e-4f50-920f-582f1844b844 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:00.391860 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ffab6-a1f3-4b38-8c2a-a241da298131 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:00.392146 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d0858-8b9e-4f50-920f-582f1844b844 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:00.392514 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d0858-8b9e-4f50-920f-582f1844b844 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:00.413006 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d0858-8b9e-4f50-920f-582f1844b844 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:13:00.419285 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-5e9d0858-8b9e-4f50-920f-582f1844b844 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:13:00.419285 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:00.419285 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:00.419285 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:00.419285 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:00.419285 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:00.419285 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:00.419285 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:00.419285 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:00.419285 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:00.419285 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:00.419285 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:00.419285 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:13:00.419285 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:13:00.419285 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:13:00.419285 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:13:00.421914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:13:00.421914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:13:00.421914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:13:00.421914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:13:00.421914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:00.421914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:00.421914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:00.421914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:00.421914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:00.421914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:00.421914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:00.421914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:00.421914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:00.421914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:00.421914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:00.421914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:00.424902 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:00.424902 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:00.424902 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:00.424902 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:00.424902 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:13:00.424902 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:13:00.424902 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:13:00.424902 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:13:00.424902 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:13:00.424902 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:13:00.424902 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:13:00.424902 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:00.424902 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 272/538] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 16:13:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:13:00.428830 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d0858-8b9e-4f50-920f-582f1844b844 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:00.444178 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b6935-407a-42d7-a97c-1e296feeea72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:00.444828 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b6935-407a-42d7-a97c-1e296feeea72 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:00.445162 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b6935-407a-42d7-a97c-1e296feeea72 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:00.445443 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b6935-407a-42d7-a97c-1e296feeea72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:00.461167 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b6935-407a-42d7-a97c-1e296feeea72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:00.463424 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b6935-407a-42d7-a97c-1e296feeea72 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:00.484826 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-8f8b6935-407a-42d7-a97c-1e296feeea72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:00.484826 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:00.484826 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:00.484826 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:00.484826 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:00.484826 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:00.484826 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:00.484826 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:00.484826 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:00.484826 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:00.484826 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:00.484826 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:00.484826 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:13:00.484826 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:13:00.484826 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:13:00.485716 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:13:00.485716 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:00.485716 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:00.485716 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:00.485716 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:00.485716 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:00.485716 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:00.485716 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:00.485716 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:00.485716 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:00.485716 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:00.485716 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:00.485716 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:00.485716 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:00.485716 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:00.485716 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:00.485716 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:00.486550 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:13:00.486550 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:13:00.486550 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:00.486550 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:00.489070 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 267/539] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:13:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:13:00.500635 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b6935-407a-42d7-a97c-1e296feeea72 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:00.547049 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d0858-8b9e-4f50-920f-582f1844b844 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:00.565665 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:00.588667 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d45a8d-01b0-4cae-86a2-f5f07233d2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:00.589312 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d45a8d-01b0-4cae-86a2-f5f07233d2b1 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:00.589620 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d45a8d-01b0-4cae-86a2-f5f07233d2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:00.589896 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d45a8d-01b0-4cae-86a2-f5f07233d2b1 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:00.591008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d45a8d-01b0-4cae-86a2-f5f07233d2b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:00.591008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d45a8d-01b0-4cae-86a2-f5f07233d2b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:00.592364 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d45a8d-01b0-4cae-86a2-f5f07233d2b1 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:00.594235 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:00.600870 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 273/540] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 16:13:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:00.605419 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b88790-dde9-40dc-82c2-2e3d341d81a3 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:00.605419 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b88790-dde9-40dc-82c2-2e3d341d81a3 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:00.605419 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b88790-dde9-40dc-82c2-2e3d341d81a3 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:00.605419 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 274/541] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:13:00.608576 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b88790-dde9-40dc-82c2-2e3d341d81a3 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:00.610346 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b6935-407a-42d7-a97c-1e296feeea72 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:00.650219 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051b2c8-479d-41fe-891a-0b69608bccd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:00.651657 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051b2c8-479d-41fe-891a-0b69608bccd7 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:00.651942 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051b2c8-479d-41fe-891a-0b69608bccd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:00.652220 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051b2c8-479d-41fe-891a-0b69608bccd7 None admin] PATH_INFO: `/v3/domains` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:00.652915 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051b2c8-479d-41fe-891a-0b69608bccd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:00.653224 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051b2c8-479d-41fe-891a-0b69608bccd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:00.654601 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051b2c8-479d-41fe-891a-0b69608bccd7 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:00.675544 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 268/542] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:13:00.677358 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978d10b-9211-43fe-b025-72857c13d441 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:00.677648 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978d10b-9211-43fe-b025-72857c13d441 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:00.677924 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978d10b-9211-43fe-b025-72857c13d441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:00.696146 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-7978d10b-9211-43fe-b025-72857c13d441 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:00.697312 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-7978d10b-9211-43fe-b025-72857c13d441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:00.729622 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b88790-dde9-40dc-82c2-2e3d341d81a3 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:00.768246 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269aa05-635d-4f01-b6e3-8cc961429a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:00.768857 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269aa05-635d-4f01-b6e3-8cc961429a28 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:00.769094 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269aa05-635d-4f01-b6e3-8cc961429a28 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:00.769374 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269aa05-635d-4f01-b6e3-8cc961429a28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:00.774389 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 269/543] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:13:00.775402 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978d10b-9211-43fe-b025-72857c13d441 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:00.793177 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269aa05-635d-4f01-b6e3-8cc961429a28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:00.795454 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269aa05-635d-4f01-b6e3-8cc961429a28 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:00.816142 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-9269aa05-635d-4f01-b6e3-8cc961429a28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:00.816142 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:00.816142 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:00.816142 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:00.816142 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:00.816142 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:00.816142 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:00.816142 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:00.816142 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:00.816142 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:00.816142 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:00.816142 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:00.816142 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:13:00.816142 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:13:00.816142 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:13:00.817125 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:13:00.817125 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:00.817125 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:00.817125 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:00.817125 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:00.817125 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:00.817125 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:00.817125 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:00.817125 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:00.817125 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:00.817125 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:00.817125 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:00.817125 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:00.817125 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:00.817125 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:00.817125 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:00.817125 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:00.817991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:13:00.817991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:13:00.817991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:00.817991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:00.817991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 275/544] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:13:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:00.818279 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269aa05-635d-4f01-b6e3-8cc961429a28 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:00.867410 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:00.895457 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:00.917963 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978d10b-9211-43fe-b025-72857c13d441 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:00.954980 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269aa05-635d-4f01-b6e3-8cc961429a28 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:00.956491 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f6643-64ee-4ddd-84d8-2266dab1a0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:00.957137 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f6643-64ee-4ddd-84d8-2266dab1a0c3 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:00.957420 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f6643-64ee-4ddd-84d8-2266dab1a0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:00.957695 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f6643-64ee-4ddd-84d8-2266dab1a0c3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:00.964921 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f6643-64ee-4ddd-84d8-2266dab1a0c3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:00.966371 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f6643-64ee-4ddd-84d8-2266dab1a0c3 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:00.979966 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-dd3f6643-64ee-4ddd-84d8-2266dab1a0c3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 16:13:00.979966 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:00.979966 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:00.979966 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:00.979966 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:00.979966 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:00.979966 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:00.979966 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:00.979966 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:00.979966 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:00.979966 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:00.979966 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:00.979966 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:13:00.979966 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:13:00.979966 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:13:00.979966 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:13:00.980878 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:00.980878 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:00.980878 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:13:00.980878 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:13:00.980878 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:13:00.980878 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:13:00.980878 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:00.980878 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:00.980878 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:00.980878 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:00.980878 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:00.980878 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:00.980878 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:00.980878 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:00.980878 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:00.980878 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:00.980878 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:00.980878 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:00.981754 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:00.981754 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:00.981754 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:13:00.981754 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:13:00.981754 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:13:00.981754 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:13:00.981754 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:13:00.981754 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:13:00.981754 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 16:13:00.981754 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:00.981754 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 270/545] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Jul 27 16:13:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:00.982294 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f6643-64ee-4ddd-84d8-2266dab1a0c3 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:00.999528 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1688672-b4a3-41a8-921c-0f4285d3e5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:01.000184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1688672-b4a3-41a8-921c-0f4285d3e5d6 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:01.000471 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1688672-b4a3-41a8-921c-0f4285d3e5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:01.000753 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1688672-b4a3-41a8-921c-0f4285d3e5d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:01.011345 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1688672-b4a3-41a8-921c-0f4285d3e5d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:13:01.017372 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-e1688672-b4a3-41a8-921c-0f4285d3e5d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:13:01.017372 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:01.017372 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:01.017372 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:01.017372 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:01.017372 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:01.017372 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:01.017372 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:01.017372 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:01.017372 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:01.017372 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:01.017372 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:01.017372 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:13:01.017372 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:13:01.017372 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:13:01.017372 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:13:01.018480 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:13:01.018480 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:13:01.018480 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:13:01.018480 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:13:01.018480 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:01.018480 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:01.018480 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:01.018480 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:01.018480 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:01.018480 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:01.018480 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:01.018480 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:01.018480 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:01.018480 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:01.018480 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:01.018480 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:01.024377 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:01.024377 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:01.024377 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:01.024377 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:01.024377 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:13:01.024377 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:13:01.024377 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:13:01.024377 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:13:01.024377 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:13:01.024377 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:13:01.024377 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:13:01.024377 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:01.024377 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 276/546] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 16:13:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:01.024377 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1688672-b4a3-41a8-921c-0f4285d3e5d6 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:01.087277 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f6643-64ee-4ddd-84d8-2266dab1a0c3 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:01.116069 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:01.122027 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9725c3-eab9-40b5-9be1-ea183db68074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:01.122654 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9725c3-eab9-40b5-9be1-ea183db68074 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:01.122938 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9725c3-eab9-40b5-9be1-ea183db68074 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:01.123217 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9725c3-eab9-40b5-9be1-ea183db68074 None admin] PATH_INFO: `/v3/domains` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:01.123938 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9725c3-eab9-40b5-9be1-ea183db68074 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:01.124249 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9725c3-eab9-40b5-9be1-ea183db68074 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:01.125608 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1688672-b4a3-41a8-921c-0f4285d3e5d6 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:01.125738 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9725c3-eab9-40b5-9be1-ea183db68074 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:01.134427 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:01.138023 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 271/547] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:01.139505 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d0622-7091-4951-a680-ac9ef2a5a322 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:01.140477 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d0622-7091-4951-a680-ac9ef2a5a322 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:01.140790 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d0622-7091-4951-a680-ac9ef2a5a322 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:01.142149 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 272/548] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:13:01.142688 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d0622-7091-4951-a680-ac9ef2a5a322 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:01.165867 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0da13-d65f-469b-9c44-e1e21dd95ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:01.166493 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0da13-d65f-469b-9c44-e1e21dd95ac5 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:01.166778 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0da13-d65f-469b-9c44-e1e21dd95ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:01.167057 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0da13-d65f-469b-9c44-e1e21dd95ac5 None admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:01.168109 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0da13-d65f-469b-9c44-e1e21dd95ac5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:01.168419 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0da13-d65f-469b-9c44-e1e21dd95ac5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:01.169882 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0da13-d65f-469b-9c44-e1e21dd95ac5 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:01.212612 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 277/549] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Jul 27 16:13:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:01.213518 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0da13-d65f-469b-9c44-e1e21dd95ac5 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:01.258291 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d0622-7091-4951-a680-ac9ef2a5a322 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:01.292489 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ba2b6-7e7b-443a-a7a9-6f1cefce7267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:01.293032 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ba2b6-7e7b-443a-a7a9-6f1cefce7267 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:01.293321 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ba2b6-7e7b-443a-a7a9-6f1cefce7267 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:01.293608 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ba2b6-7e7b-443a-a7a9-6f1cefce7267 None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:01.294322 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ba2b6-7e7b-443a-a7a9-6f1cefce7267 None admin] RBAC: Adding query filter params (name=service) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:01.294632 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ba2b6-7e7b-443a-a7a9-6f1cefce7267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:01.296156 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ba2b6-7e7b-443a-a7a9-6f1cefce7267 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:01.309151 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 273/550] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 16:13:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:01.309151 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581877a-d6e0-46df-9b5c-82b80a5cc3b5 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:01.309151 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581877a-d6e0-46df-9b5c-82b80a5cc3b5 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:01.309151 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581877a-d6e0-46df-9b5c-82b80a5cc3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:01.316579 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0da13-d65f-469b-9c44-e1e21dd95ac5 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:01.324678 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-1581877a-d6e0-46df-9b5c-82b80a5cc3b5 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:01.325884 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-1581877a-d6e0-46df-9b5c-82b80a5cc3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:01.350209 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ffb62-953c-41fe-b58e-2c0211275f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:01.350854 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ffb62-953c-41fe-b58e-2c0211275f3b None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:01.351139 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ffb62-953c-41fe-b58e-2c0211275f3b None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:01.351484 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ffb62-953c-41fe-b58e-2c0211275f3b None admin] PATH_INFO: `/v3/users/glance` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:01.358639 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ffb62-953c-41fe-b58e-2c0211275f3b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:01.360759 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ffb62-953c-41fe-b58e-2c0211275f3b None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:01.373008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-f36ffb62-953c-41fe-b58e-2c0211275f3b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 16:13:01.373008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:01.373008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:01.373008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:01.373008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:01.373008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:01.373008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:01.373008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:01.373008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:01.373008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:01.373008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:01.373008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:01.373008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:13:01.373008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:13:01.373008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:13:01.373008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:13:01.374090 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:01.374090 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:01.374090 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:13:01.374090 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:13:01.374090 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:13:01.374090 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:13:01.374090 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:01.374090 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:01.374090 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:01.374090 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:01.374090 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:01.374090 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:01.374090 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:01.374090 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:01.374090 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:01.374090 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:01.374090 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:01.374090 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:01.376478 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:01.376478 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:01.376478 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:13:01.376478 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:13:01.376478 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:13:01.376478 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:13:01.376478 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:13:01.376478 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:13:01.376478 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 16:13:01.376478 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:01.376478 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 278/551] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:13:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:01.376478 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ffb62-953c-41fe-b58e-2c0211275f3b None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:01.385255 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:01.389188 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:01.397388 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 274/552] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:13:01.398279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581877a-d6e0-46df-9b5c-82b80a5cc3b5 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:01.484450 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ffb62-953c-41fe-b58e-2c0211275f3b None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:01.521475 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581877a-d6e0-46df-9b5c-82b80a5cc3b5 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:01.533729 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a3924-e991-474d-8b0b-a79781f4c203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:01.534363 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a3924-e991-474d-8b0b-a79781f4c203 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:01.534653 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a3924-e991-474d-8b0b-a79781f4c203 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:01.534925 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a3924-e991-474d-8b0b-a79781f4c203 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:01.545686 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a3924-e991-474d-8b0b-a79781f4c203 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:01.547268 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a3924-e991-474d-8b0b-a79781f4c203 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:01.556829 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe754ac-19d4-400c-a69d-782bbb971829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:01.557469 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe754ac-19d4-400c-a69d-782bbb971829 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:01.557755 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe754ac-19d4-400c-a69d-782bbb971829 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:01.558032 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe754ac-19d4-400c-a69d-782bbb971829 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:01.561195 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-060a3924-e991-474d-8b0b-a79781f4c203 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:01.561195 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:01.561195 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:01.561195 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:01.561195 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:01.561195 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:01.561195 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:01.561195 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:01.561195 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:01.561195 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:01.561195 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:01.561195 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:01.561195 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:13:01.561195 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:13:01.561195 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:13:01.562718 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:13:01.562718 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:01.562718 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:01.562718 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:01.562718 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:01.562718 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:01.562718 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:01.562718 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:01.562718 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:01.562718 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:01.562718 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:01.562718 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:01.562718 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:01.562718 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:01.562718 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:01.562718 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:01.562718 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:01.563662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:13:01.563662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:13:01.563662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:01.563662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:01.563662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 279/553] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:13:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:01.564061 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a3924-e991-474d-8b0b-a79781f4c203 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:01.569346 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe754ac-19d4-400c-a69d-782bbb971829 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:01.570794 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe754ac-19d4-400c-a69d-782bbb971829 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:01.586510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-8fe754ac-19d4-400c-a69d-782bbb971829 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:01.586510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:01.586510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:01.586510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:01.586510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:01.586510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:01.586510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:01.586510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:01.586510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:01.586510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:01.586510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:01.586510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:01.586510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:13:01.586510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:13:01.586510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:13:01.592391 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:13:01.592391 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:01.592391 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:01.592391 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:01.592391 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:01.592391 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:01.592391 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:01.592391 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:01.592391 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:01.592391 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:01.592391 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:01.592391 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:01.592391 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:01.592391 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:01.592391 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:01.592391 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:01.592391 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:01.593481 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:13:01.593481 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:13:01.593481 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:01.593481 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:01.593481 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 275/554] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:13:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:01.593481 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe754ac-19d4-400c-a69d-782bbb971829 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:01.627107 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:01.639145 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:01.668169 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a3924-e991-474d-8b0b-a79781f4c203 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:01.700190 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe754ac-19d4-400c-a69d-782bbb971829 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:01.709490 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364e5c2-8dc7-4cb3-9ab6-53cc5d575fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:01.710119 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364e5c2-8dc7-4cb3-9ab6-53cc5d575fa7 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:01.710403 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364e5c2-8dc7-4cb3-9ab6-53cc5d575fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:01.710680 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364e5c2-8dc7-4cb3-9ab6-53cc5d575fa7 None admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:01.711518 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4364e5c2-8dc7-4cb3-9ab6-53cc5d575fa7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:01.711830 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4364e5c2-8dc7-4cb3-9ab6-53cc5d575fa7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:01.713298 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4364e5c2-8dc7-4cb3-9ab6-53cc5d575fa7 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:01.730891 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 280/555] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Jul 27 16:13:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:01.731579 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364e5c2-8dc7-4cb3-9ab6-53cc5d575fa7 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:01.740775 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79052dc5-1711-4daf-8011-bccca961952c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:01.741420 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79052dc5-1711-4daf-8011-bccca961952c None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:01.741709 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79052dc5-1711-4daf-8011-bccca961952c None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:01.741984 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79052dc5-1711-4daf-8011-bccca961952c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:01.753140 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79052dc5-1711-4daf-8011-bccca961952c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:13:01.758699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-79052dc5-1711-4daf-8011-bccca961952c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:13:01.758699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:01.758699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:01.758699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:01.758699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:01.758699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:01.758699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:01.758699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:01.758699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:01.758699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:01.758699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:01.758699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:01.758699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:13:01.758699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:13:01.758699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:13:01.758699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:13:01.759722 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:13:01.759722 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:13:01.759722 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:13:01.759722 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:13:01.759722 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:01.759722 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:01.759722 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:01.759722 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:01.759722 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:01.759722 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:01.759722 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:01.759722 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:01.759722 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:01.759722 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:01.759722 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:01.759722 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:01.761149 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:01.761149 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:01.761149 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:01.761149 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:01.761149 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:13:01.761149 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:13:01.761149 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:13:01.761149 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:13:01.761149 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:13:01.761149 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:13:01.761149 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:13:01.761149 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:01.761149 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 276/556] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 16:13:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:01.761149 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79052dc5-1711-4daf-8011-bccca961952c None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:01.837302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364e5c2-8dc7-4cb3-9ab6-53cc5d575fa7 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:01.856595 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:01.865728 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79052dc5-1711-4daf-8011-bccca961952c None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:01.868066 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:01.870973 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db5995-8922-4d6d-b6e6-91c12890f3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:01.871613 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db5995-8922-4d6d-b6e6-91c12890f3ba None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:01.871898 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db5995-8922-4d6d-b6e6-91c12890f3ba None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:01.872171 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db5995-8922-4d6d-b6e6-91c12890f3ba None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:01.872856 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db5995-8922-4d6d-b6e6-91c12890f3ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:01.873276 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db5995-8922-4d6d-b6e6-91c12890f3ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:01.875048 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db5995-8922-4d6d-b6e6-91c12890f3ba None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:01.886182 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 281/557] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:01.886985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db5995-8922-4d6d-b6e6-91c12890f3ba None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:01.902374 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf992f6-76c2-40d8-803c-1c69c66a3397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:01.902998 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf992f6-76c2-40d8-803c-1c69c66a3397 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:01.903280 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf992f6-76c2-40d8-803c-1c69c66a3397 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:01.903587 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf992f6-76c2-40d8-803c-1c69c66a3397 None admin] PATH_INFO: `/v3/domains` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:01.904279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf992f6-76c2-40d8-803c-1c69c66a3397 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:01.904586 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf992f6-76c2-40d8-803c-1c69c66a3397 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:01.905985 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf992f6-76c2-40d8-803c-1c69c66a3397 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:01.922112 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 277/558] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:01.922973 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf992f6-76c2-40d8-803c-1c69c66a3397 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:01.987972 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db5995-8922-4d6d-b6e6-91c12890f3ba None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:02.022972 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf992f6-76c2-40d8-803c-1c69c66a3397 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:02.023971 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f95bb-560e-4b8a-8843-dcb03efdc323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:02.024622 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f95bb-560e-4b8a-8843-dcb03efdc323 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:02.024905 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f95bb-560e-4b8a-8843-dcb03efdc323 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:02.025188 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f95bb-560e-4b8a-8843-dcb03efdc323 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:02.036369 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f95bb-560e-4b8a-8843-dcb03efdc323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:02.037835 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f95bb-560e-4b8a-8843-dcb03efdc323 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:02.055782 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-046f95bb-560e-4b8a-8843-dcb03efdc323 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:02.055782 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:02.055782 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:02.055782 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:02.055782 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:02.055782 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:02.055782 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:02.055782 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:02.055782 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:02.055782 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:02.055782 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:02.055782 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:02.055782 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:13:02.055782 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:13:02.055782 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:13:02.057394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:13:02.057394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:02.057394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:02.057394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:02.057394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:02.057394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:02.057394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:02.057394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:02.057394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:02.057394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:02.057394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:02.057394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:02.057394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:02.057394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:02.057394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:02.057394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:02.057394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:02.058527 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:13:02.058527 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:13:02.058527 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:02.058527 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:02.058527 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 282/559] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:13:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:02.058527 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f95bb-560e-4b8a-8843-dcb03efdc323 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:02.064121 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77c5f5-c50a-46cb-855f-fe6872fa1af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:02.064775 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77c5f5-c50a-46cb-855f-fe6872fa1af3 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:02.065061 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77c5f5-c50a-46cb-855f-fe6872fa1af3 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:02.065340 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77c5f5-c50a-46cb-855f-fe6872fa1af3 None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:02.066072 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77c5f5-c50a-46cb-855f-fe6872fa1af3 None admin] RBAC: Adding query filter params (name=service) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:02.066383 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77c5f5-c50a-46cb-855f-fe6872fa1af3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:02.067785 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77c5f5-c50a-46cb-855f-fe6872fa1af3 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:02.076295 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 278/560] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 16:13:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:02.077171 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77c5f5-c50a-46cb-855f-fe6872fa1af3 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:02.094256 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:02.108475 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:02.168489 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f95bb-560e-4b8a-8843-dcb03efdc323 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:02.181047 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77c5f5-c50a-46cb-855f-fe6872fa1af3 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:02.202103 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8487bf-092b-4999-823f-9e09a30e59ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:02.203341 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8487bf-092b-4999-823f-9e09a30e59ed None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:02.203729 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8487bf-092b-4999-823f-9e09a30e59ed None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:02.204076 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8487bf-092b-4999-823f-9e09a30e59ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:02.210822 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8487bf-092b-4999-823f-9e09a30e59ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:02.212318 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8487bf-092b-4999-823f-9e09a30e59ed None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:02.214091 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16f1e9-ca41-4775-9246-bab11c826618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:02.214729 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16f1e9-ca41-4775-9246-bab11c826618 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:02.215008 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16f1e9-ca41-4775-9246-bab11c826618 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:02.215280 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16f1e9-ca41-4775-9246-bab11c826618 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:02.223246 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b16f1e9-ca41-4775-9246-bab11c826618 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:02.224178 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-cd8487bf-092b-4999-823f-9e09a30e59ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:13:02.224178 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:02.224178 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:02.224178 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:02.224178 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:02.224178 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:02.224178 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:02.224178 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:02.224178 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:02.224178 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:02.224178 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:02.224178 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:02.224178 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:13:02.224178 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:13:02.224178 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:13:02.225184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:13:02.225184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:02.225184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:02.225184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:02.225184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:02.225184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:02.225184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:02.225184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:02.225184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:02.225184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:02.225184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:02.225184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:02.225184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:02.225184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:02.225184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:02.225184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:02.225184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:02.226107 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:13:02.226107 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:13:02.226107 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:13:02.226107 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:13:02.226107 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:13:02.226107 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:13:02.226107 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:13:02.226107 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:02.226554 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b16f1e9-ca41-4775-9246-bab11c826618 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:02.226630 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 283/561] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:13:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:02.226630 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8487bf-092b-4999-823f-9e09a30e59ed None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:02.236142 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-4b16f1e9-ca41-4775-9246-bab11c826618 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 16:13:02.236142 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:02.236142 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:02.236142 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:02.236142 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:02.236142 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:02.236142 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:02.236142 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:02.236142 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:02.236142 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:02.236142 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:02.236142 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:02.236142 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:13:02.236142 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:13:02.236142 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:13:02.236142 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:13:02.237260 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:02.237260 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:02.237260 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:13:02.237260 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:13:02.237260 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:13:02.237260 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:13:02.237260 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:02.237260 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:02.237260 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:02.237260 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:02.237260 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:02.237260 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:02.237260 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:02.237260 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:02.237260 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:02.237260 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:02.237260 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:02.237260 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:02.242979 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:02.242979 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:02.242979 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:13:02.242979 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:13:02.242979 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:13:02.242979 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:13:02.242979 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:13:02.242979 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:13:02.242979 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 16:13:02.242979 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:02.242979 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 279/562] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:13:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:02.242979 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16f1e9-ca41-4775-9246-bab11c826618 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:02.324264 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:02.326758 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:02.336343 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8487bf-092b-4999-823f-9e09a30e59ed None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:02.339565 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16f1e9-ca41-4775-9246-bab11c826618 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:02.369239 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36247f63-d255-4f58-973b-54a842581261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:02.369796 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36247f63-d255-4f58-973b-54a842581261 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:02.370084 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36247f63-d255-4f58-973b-54a842581261 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:02.370365 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36247f63-d255-4f58-973b-54a842581261 None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:02.371055 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36247f63-d255-4f58-973b-54a842581261 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:02.371365 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36247f63-d255-4f58-973b-54a842581261 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:02.372630 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07932d84-e549-4c4f-90e9-d42fb6541971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:02.372800 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36247f63-d255-4f58-973b-54a842581261 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:02.373261 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07932d84-e549-4c4f-90e9-d42fb6541971 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:02.373545 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07932d84-e549-4c4f-90e9-d42fb6541971 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:02.373820 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07932d84-e549-4c4f-90e9-d42fb6541971 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:02.384676 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07932d84-e549-4c4f-90e9-d42fb6541971 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:02.385548 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 284/563] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:02.386193 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07932d84-e549-4c4f-90e9-d42fb6541971 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:02.386377 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36247f63-d255-4f58-973b-54a842581261 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:02.404602 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-07932d84-e549-4c4f-90e9-d42fb6541971 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:02.404602 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:02.404602 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:02.404602 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:02.404602 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:02.404602 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:02.404602 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:02.404602 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:02.404602 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:02.404602 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:02.404602 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:02.404602 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:02.404602 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:13:02.404602 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:13:02.404602 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:13:02.406223 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:13:02.406223 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:02.406223 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:02.406223 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:02.406223 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:02.406223 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:02.406223 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:02.406223 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:02.406223 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:02.406223 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:02.406223 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:02.406223 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:02.406223 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:02.406223 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:02.406223 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:02.406223 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:02.406223 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:02.407325 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:13:02.407325 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:13:02.407325 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:02.407325 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:02.407325 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 280/564] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:13:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:02.407325 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07932d84-e549-4c4f-90e9-d42fb6541971 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:02.491544 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36247f63-d255-4f58-973b-54a842581261 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:02.512769 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07932d84-e549-4c4f-90e9-d42fb6541971 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:02.527068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528ae59-8993-4975-9b8c-67b7cf7c8569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:02.527734 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528ae59-8993-4975-9b8c-67b7cf7c8569 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:02.528028 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528ae59-8993-4975-9b8c-67b7cf7c8569 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:02.528310 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528ae59-8993-4975-9b8c-67b7cf7c8569 None admin] PATH_INFO: `/v3/projects` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:02.529151 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3528ae59-8993-4975-9b8c-67b7cf7c8569 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:02.529406 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3528ae59-8993-4975-9b8c-67b7cf7c8569 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:02.531357 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3528ae59-8993-4975-9b8c-67b7cf7c8569 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:02.544865 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 285/565] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 16:13:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:02.545717 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528ae59-8993-4975-9b8c-67b7cf7c8569 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:02.556496 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34795f08-16f7-437f-a409-9e14aadb04e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:02.557126 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34795f08-16f7-437f-a409-9e14aadb04e9 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:02.557411 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34795f08-16f7-437f-a409-9e14aadb04e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:02.557687 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34795f08-16f7-437f-a409-9e14aadb04e9 None admin] PATH_INFO: `/v3/users` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:02.558490 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34795f08-16f7-437f-a409-9e14aadb04e9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:02.558800 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34795f08-16f7-437f-a409-9e14aadb04e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:02.560384 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34795f08-16f7-437f-a409-9e14aadb04e9 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:02.569458 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:02.570002 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:02.582617 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 281/566] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Jul 27 16:13:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:02.583483 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34795f08-16f7-437f-a409-9e14aadb04e9 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:02.657168 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528ae59-8993-4975-9b8c-67b7cf7c8569 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:02.687276 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34795f08-16f7-437f-a409-9e14aadb04e9 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:02.691803 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196ff28-79e7-44cd-90d2-bf7a507d8df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:02.692472 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196ff28-79e7-44cd-90d2-bf7a507d8df9 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:02.692752 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196ff28-79e7-44cd-90d2-bf7a507d8df9 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:02.693018 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196ff28-79e7-44cd-90d2-bf7a507d8df9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:02.699709 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196ff28-79e7-44cd-90d2-bf7a507d8df9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:02.701156 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196ff28-79e7-44cd-90d2-bf7a507d8df9 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:02.713008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-8196ff28-79e7-44cd-90d2-bf7a507d8df9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:13:02.713008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:02.713008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:02.713008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:02.713008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:02.713008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:02.713008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:02.713008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:02.713008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:02.713008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:02.713008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:02.713008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:02.713008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:13:02.713008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:13:02.713008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:13:02.714115 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:13:02.714115 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:02.714115 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:02.714115 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:02.714115 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:02.714115 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:02.714115 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:02.714115 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:02.714115 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:02.714115 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:02.714115 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:02.714115 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:02.714115 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:02.714115 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:02.714115 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:02.714115 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:02.714115 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:02.715189 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:13:02.715189 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:13:02.715189 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:13:02.715189 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:13:02.715189 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:13:02.715189 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:13:02.715189 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:13:02.715189 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:02.719611 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 286/567] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:13:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:02.720299 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196ff28-79e7-44cd-90d2-bf7a507d8df9 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:02.721938 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e179915-789d-4b90-8a7f-2fca7d0f16a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:02.722566 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e179915-789d-4b90-8a7f-2fca7d0f16a8 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:02.723027 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e179915-789d-4b90-8a7f-2fca7d0f16a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:02.723304 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e179915-789d-4b90-8a7f-2fca7d0f16a8 None admin] PATH_INFO: `/v3/domains` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:02.724025 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e179915-789d-4b90-8a7f-2fca7d0f16a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:02.724328 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e179915-789d-4b90-8a7f-2fca7d0f16a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:02.725680 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e179915-789d-4b90-8a7f-2fca7d0f16a8 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:02.737531 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 282/568] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:02.738531 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e179915-789d-4b90-8a7f-2fca7d0f16a8 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:02.795664 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:02.797216 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:02.825420 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196ff28-79e7-44cd-90d2-bf7a507d8df9 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:02.841221 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e179915-789d-4b90-8a7f-2fca7d0f16a8 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:02.866035 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fa961-71e7-4774-aacf-3ca6ab627e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:02.866733 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fa961-71e7-4774-aacf-3ca6ab627e93 None admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:02.867144 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fa961-71e7-4774-aacf-3ca6ab627e93 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:02.867443 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fa961-71e7-4774-aacf-3ca6ab627e93 None admin] PATH_INFO: `/v3/projects/73d63a3d7b724a5998ea2976430f242d/users/66768f9443c046b3bd75853a4b2b980e/roles/738aa511871f47acb7169da7e104be79` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:02.881525 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d85a0-ba18-4a93-a594-d20d6b45511c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:02.882191 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d85a0-ba18-4a93-a594-d20d6b45511c None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:02.882478 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d85a0-ba18-4a93-a594-d20d6b45511c None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:02.887986 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d85a0-ba18-4a93-a594-d20d6b45511c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:02.889750 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0fa961-71e7-4774-aacf-3ca6ab627e93 None admin] RBAC: Authorizing `identity:create_grant(project_id=73d63a3d7b724a5998ea2976430f242d, user_id=66768f9443c046b3bd75853a4b2b980e, role_id=738aa511871f47acb7169da7e104be79)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:02.892270 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0fa961-71e7-4774-aacf-3ca6ab627e93 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:02.895673 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d85a0-ba18-4a93-a594-d20d6b45511c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:02.897511 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d85a0-ba18-4a93-a594-d20d6b45511c None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:02.907664 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 287/569] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 16:13:02 2022] PUT /identity/v3/projects/73d63a3d7b724a5998ea2976430f242d/users/66768f9443c046b3bd75853a4b2b980e/roles/738aa511871f47acb7169da7e104be79 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:13:02.908435 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fa961-71e7-4774-aacf-3ca6ab627e93 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:02.926596 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-c78d85a0-ba18-4a93-a594-d20d6b45511c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:02.926596 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:02.926596 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:02.926596 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:02.926596 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:02.926596 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:02.926596 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:02.926596 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:02.926596 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:02.926596 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:02.926596 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:02.926596 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:02.926596 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:13:02.926596 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:13:02.926596 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:13:02.928399 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:13:02.928399 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:02.928399 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:02.928399 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:02.928399 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:02.928399 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:02.928399 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:02.928399 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:02.928399 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:02.928399 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:02.928399 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:02.928399 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:02.928399 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:02.928399 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:02.928399 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:02.928399 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:02.928399 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:02.929404 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:13:02.929404 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:13:02.929404 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:02.929404 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:02.929404 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 283/570] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:13:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:02.930260 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d85a0-ba18-4a93-a594-d20d6b45511c None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:03.029107 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fa961-71e7-4774-aacf-3ca6ab627e93 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:03.048125 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d85a0-ba18-4a93-a594-d20d6b45511c None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:03.054806 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:03.059417 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:03.070356 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a861b-880a-420b-94e4-39f26743c86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:03.070989 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a861b-880a-420b-94e4-39f26743c86b None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:03.071494 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a861b-880a-420b-94e4-39f26743c86b None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:03.071601 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a861b-880a-420b-94e4-39f26743c86b None admin] PATH_INFO: `/v3/projects` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:03.072360 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a861b-880a-420b-94e4-39f26743c86b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:03.072804 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a861b-880a-420b-94e4-39f26743c86b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:03.074596 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a861b-880a-420b-94e4-39f26743c86b None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:03.090937 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 288/571] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 16:13:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:03.093731 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51730010-e3b2-42a2-b712-d2659a5b9464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:03.094584 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51730010-e3b2-42a2-b712-d2659a5b9464 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:03.095021 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51730010-e3b2-42a2-b712-d2659a5b9464 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:03.095535 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51730010-e3b2-42a2-b712-d2659a5b9464 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:03.096433 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a861b-880a-420b-94e4-39f26743c86b None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:03.104341 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51730010-e3b2-42a2-b712-d2659a5b9464 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:03.105813 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51730010-e3b2-42a2-b712-d2659a5b9464 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:03.118717 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-51730010-e3b2-42a2-b712-d2659a5b9464 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 16:13:03.118717 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:03.118717 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:03.118717 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:03.118717 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:03.118717 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:03.118717 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:03.118717 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:03.118717 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:03.118717 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:03.118717 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:03.118717 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:03.118717 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:13:03.118717 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:13:03.118717 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:13:03.118717 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:13:03.119943 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:03.119943 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:03.119943 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:13:03.119943 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:13:03.119943 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:13:03.119943 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:13:03.119943 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:03.119943 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:03.119943 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:03.119943 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:03.119943 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:03.119943 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:03.119943 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:03.119943 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:03.119943 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:03.119943 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:03.119943 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:03.119943 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:03.120994 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:03.120994 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:03.120994 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:13:03.120994 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:13:03.120994 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:13:03.120994 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:13:03.120994 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:13:03.120994 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:13:03.120994 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 16:13:03.120994 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:03.120994 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 284/572] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 16:13:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:03.121587 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51730010-e3b2-42a2-b712-d2659a5b9464 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:03.209575 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a861b-880a-420b-94e4-39f26743c86b None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:03.242352 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51730010-e3b2-42a2-b712-d2659a5b9464 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:03.245488 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45616792-be7c-4048-9ab7-af2db66cbbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:03.246034 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45616792-be7c-4048-9ab7-af2db66cbbf2 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:03.246321 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45616792-be7c-4048-9ab7-af2db66cbbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:03.246603 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45616792-be7c-4048-9ab7-af2db66cbbf2 None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:03.247305 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45616792-be7c-4048-9ab7-af2db66cbbf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:03.247647 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45616792-be7c-4048-9ab7-af2db66cbbf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:03.249046 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45616792-be7c-4048-9ab7-af2db66cbbf2 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:03.267721 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 289/573] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:03.269281 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45616792-be7c-4048-9ab7-af2db66cbbf2 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:03.278996 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42cbdd1-acc5-49b3-b0af-7ffaa92ff1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:03.279707 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cbdd1-acc5-49b3-b0af-7ffaa92ff1c8 None admin] REQUEST_METHOD: `PUT` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:03.280007 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cbdd1-acc5-49b3-b0af-7ffaa92ff1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:03.280275 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cbdd1-acc5-49b3-b0af-7ffaa92ff1c8 None admin] PATH_INFO: `/v3/projects/73d63a3d7b724a5998ea2976430f242d/users/43377fb5ab3c4ddfb54b3b2cae8eb351/roles/738aa511871f47acb7169da7e104be79` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:03.298017 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42cbdd1-acc5-49b3-b0af-7ffaa92ff1c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=73d63a3d7b724a5998ea2976430f242d, user_id=43377fb5ab3c4ddfb54b3b2cae8eb351, role_id=738aa511871f47acb7169da7e104be79)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:03.299533 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42cbdd1-acc5-49b3-b0af-7ffaa92ff1c8 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:03.317168 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:03.323935 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 285/574] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 16:13:03 2022] PUT /identity/v3/projects/73d63a3d7b724a5998ea2976430f242d/users/43377fb5ab3c4ddfb54b3b2cae8eb351/roles/738aa511871f47acb7169da7e104be79 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:13:03.325512 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42cbdd1-acc5-49b3-b0af-7ffaa92ff1c8 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:03.358000 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:03.393995 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45616792-be7c-4048-9ab7-af2db66cbbf2 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:03.436120 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972858a-044e-4224-a81e-868e65d499d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:03.436993 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972858a-044e-4224-a81e-868e65d499d6 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:03.437352 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972858a-044e-4224-a81e-868e65d499d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:03.437699 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972858a-044e-4224-a81e-868e65d499d6 None admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:03.438700 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972858a-044e-4224-a81e-868e65d499d6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:03.439079 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972858a-044e-4224-a81e-868e65d499d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:03.440670 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972858a-044e-4224-a81e-868e65d499d6 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:03.469659 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 290/575] 10.222.0.65 () {56 vars in 1139 bytes} [Wed Jul 27 16:13:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:03.474731 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972858a-044e-4224-a81e-868e65d499d6 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:03.485802 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42cbdd1-acc5-49b3-b0af-7ffaa92ff1c8 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:03.532818 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024956c2-9e95-4418-a173-917ff01c2be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:03.533845 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024956c2-9e95-4418-a173-917ff01c2be7 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:03.534313 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024956c2-9e95-4418-a173-917ff01c2be7 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:03.534771 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024956c2-9e95-4418-a173-917ff01c2be7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:03.544637 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024956c2-9e95-4418-a173-917ff01c2be7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:03.546455 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024956c2-9e95-4418-a173-917ff01c2be7 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:03.558374 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-024956c2-9e95-4418-a173-917ff01c2be7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:13:03.558374 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:03.558374 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:03.558374 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:03.558374 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:03.558374 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:03.558374 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:03.558374 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:03.558374 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:03.558374 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:03.558374 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:03.558374 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:03.558374 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:13:03.558374 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:13:03.558374 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:13:03.559282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:13:03.559282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:03.559282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:03.559282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:03.559282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:03.559282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:03.559282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:03.559282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:03.559282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:03.559282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:03.559282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:03.559282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:03.559282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:03.559282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:03.559282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:03.559282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:03.559282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:03.560460 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:13:03.560460 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:13:03.560460 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:13:03.560460 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:13:03.560460 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:13:03.560460 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:13:03.560460 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:13:03.560460 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:03.562724 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 286/576] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:13:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:03.570051 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024956c2-9e95-4418-a173-917ff01c2be7 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:03.601718 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:03.606929 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972858a-044e-4224-a81e-868e65d499d6 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:03.650219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3dad32-c7f2-4411-9639-9a89b051c040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:03.651112 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dad32-c7f2-4411-9639-9a89b051c040 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:03.651565 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dad32-c7f2-4411-9639-9a89b051c040 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:03.651925 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dad32-c7f2-4411-9639-9a89b051c040 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:03.663133 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3dad32-c7f2-4411-9639-9a89b051c040 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:03.665496 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3dad32-c7f2-4411-9639-9a89b051c040 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:03.681844 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:03.684182 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-cb3dad32-c7f2-4411-9639-9a89b051c040 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:03.684182 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:03.684182 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:03.684182 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:03.684182 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:03.684182 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:03.684182 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:03.684182 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:03.684182 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:03.684182 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:03.684182 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:03.684182 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:03.684182 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:13:03.684182 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:13:03.684182 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:13:03.685293 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:13:03.685293 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:03.685293 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:03.685293 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:03.685293 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:03.685293 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:03.685293 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:03.685293 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:03.685293 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:03.685293 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:03.685293 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:03.685293 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:03.685293 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:03.685293 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:03.685293 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:03.685293 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:03.685293 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:03.686393 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:13:03.686393 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:13:03.686393 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:03.686393 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:03.692862 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 291/577] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:13:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:13:03.694557 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3dad32-c7f2-4411-9639-9a89b051c040 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:03.705439 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024956c2-9e95-4418-a173-917ff01c2be7 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:03.751464 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df315ab2-50a5-4cf7-ae2e-d0b996366fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:03.752321 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df315ab2-50a5-4cf7-ae2e-d0b996366fa2 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:03.752782 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df315ab2-50a5-4cf7-ae2e-d0b996366fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:03.753225 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df315ab2-50a5-4cf7-ae2e-d0b996366fa2 None admin] PATH_INFO: `/v3/projects` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:03.754390 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df315ab2-50a5-4cf7-ae2e-d0b996366fa2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:03.754934 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df315ab2-50a5-4cf7-ae2e-d0b996366fa2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:03.756625 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df315ab2-50a5-4cf7-ae2e-d0b996366fa2 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:03.775711 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 287/578] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 16:13:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:03.777507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df315ab2-50a5-4cf7-ae2e-d0b996366fa2 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:03.812381 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3dad32-c7f2-4411-9639-9a89b051c040 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:03.848796 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceab3d5-a252-42cd-8237-b554aaa0e1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:03.849423 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceab3d5-a252-42cd-8237-b554aaa0e1e0 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:03.849707 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceab3d5-a252-42cd-8237-b554aaa0e1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:03.849988 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceab3d5-a252-42cd-8237-b554aaa0e1e0 None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:03.850784 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceab3d5-a252-42cd-8237-b554aaa0e1e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:03.851313 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceab3d5-a252-42cd-8237-b554aaa0e1e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:03.852758 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceab3d5-a252-42cd-8237-b554aaa0e1e0 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:03.866194 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 292/579] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:03.872068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceab3d5-a252-42cd-8237-b554aaa0e1e0 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:03.890891 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:03.892561 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df315ab2-50a5-4cf7-ae2e-d0b996366fa2 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:03.931791 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b6829-f229-46a5-8c78-89b8d09e7f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:03.932485 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b6829-f229-46a5-8c78-89b8d09e7f7f None admin] REQUEST_METHOD: `PUT` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:03.932953 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b6829-f229-46a5-8c78-89b8d09e7f7f None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:03.933112 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b6829-f229-46a5-8c78-89b8d09e7f7f None admin] PATH_INFO: `/v3/projects/73d63a3d7b724a5998ea2976430f242d/users/4b6d1f7acba3415f84c2f01b66190b8a/roles/738aa511871f47acb7169da7e104be79` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:03.941952 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:03.949899 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b6829-f229-46a5-8c78-89b8d09e7f7f None admin] RBAC: Authorizing `identity:create_grant(project_id=73d63a3d7b724a5998ea2976430f242d, user_id=4b6d1f7acba3415f84c2f01b66190b8a, role_id=738aa511871f47acb7169da7e104be79)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:03.951345 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b6829-f229-46a5-8c78-89b8d09e7f7f None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:03.971425 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 288/580] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 16:13:03 2022] PUT /identity/v3/projects/73d63a3d7b724a5998ea2976430f242d/users/4b6d1f7acba3415f84c2f01b66190b8a/roles/738aa511871f47acb7169da7e104be79 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:13:04.000157 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceab3d5-a252-42cd-8237-b554aaa0e1e0 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:04.040851 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a68b10-746c-4367-820d-e96e335f156c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:04.041431 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a68b10-746c-4367-820d-e96e335f156c None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:04.041769 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a68b10-746c-4367-820d-e96e335f156c None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:04.042048 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a68b10-746c-4367-820d-e96e335f156c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:04.050792 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a68b10-746c-4367-820d-e96e335f156c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:04.052379 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a68b10-746c-4367-820d-e96e335f156c None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:04.066088 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-59a68b10-746c-4367-820d-e96e335f156c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:13:04.066088 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:04.066088 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:04.066088 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:04.066088 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:04.066088 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:04.066088 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:04.066088 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:04.066088 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:04.066088 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:04.066088 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:04.066088 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:04.066088 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:13:04.066088 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:13:04.066088 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:13:04.067131 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:13:04.067131 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:04.067131 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:04.067131 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:04.067131 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:04.067131 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:04.067131 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:04.067131 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:04.067131 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:04.067131 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:04.067131 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:04.067131 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:04.067131 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:04.067131 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:04.067131 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:04.067131 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:04.067131 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:04.068416 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:13:04.068416 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:13:04.068416 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:13:04.068416 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:13:04.068416 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:13:04.068416 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:13:04.068416 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:13:04.068416 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:04.068834 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 293/581] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:13:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:04.080805 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b6829-f229-46a5-8c78-89b8d09e7f7f None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:04.195516 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b6829-f229-46a5-8c78-89b8d09e7f7f None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:04.232915 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed2a01-e843-4871-974f-3c61d5e9c9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:04.233540 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed2a01-e843-4871-974f-3c61d5e9c9f8 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:04.234352 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed2a01-e843-4871-974f-3c61d5e9c9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:04.234625 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed2a01-e843-4871-974f-3c61d5e9c9f8 None admin] PATH_INFO: `/v3/projects` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:04.235403 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed2a01-e843-4871-974f-3c61d5e9c9f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:04.235704 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed2a01-e843-4871-974f-3c61d5e9c9f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:04.237242 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed2a01-e843-4871-974f-3c61d5e9c9f8 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:04.250356 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 289/582] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 16:13:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:04.260638 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a68b10-746c-4367-820d-e96e335f156c None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:04.339863 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:04.371995 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a68b10-746c-4367-820d-e96e335f156c None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:04.407409 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9efeaf-18cf-4054-8916-faca15eab858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:04.408092 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9efeaf-18cf-4054-8916-faca15eab858 None admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:04.408375 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9efeaf-18cf-4054-8916-faca15eab858 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:04.408652 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9efeaf-18cf-4054-8916-faca15eab858 None admin] PATH_INFO: `/v3/projects/73d63a3d7b724a5998ea2976430f242d/users/6a95bd511e264733bf7ea71b28ad96ab/roles/738aa511871f47acb7169da7e104be79` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:04.424154 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9efeaf-18cf-4054-8916-faca15eab858 None admin] RBAC: Authorizing `identity:create_grant(project_id=73d63a3d7b724a5998ea2976430f242d, user_id=6a95bd511e264733bf7ea71b28ad96ab, role_id=738aa511871f47acb7169da7e104be79)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:04.425664 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9efeaf-18cf-4054-8916-faca15eab858 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:04.440123 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 294/583] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 16:13:04 2022] PUT /identity/v3/projects/73d63a3d7b724a5998ea2976430f242d/users/6a95bd511e264733bf7ea71b28ad96ab/roles/738aa511871f47acb7169da7e104be79 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:13:05.738363 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a48b3f-3aa2-4b30-8bd1-d326d413167f None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:05.738883 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a48b3f-3aa2-4b30-8bd1-d326d413167f None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:05.738960 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a48b3f-3aa2-4b30-8bd1-d326d413167f None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:05.740612 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 290/584] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:13:05.745990 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a705989-4795-4605-9667-a12b46ec26d8 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:05.746390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a705989-4795-4605-9667-a12b46ec26d8 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:05.746572 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a705989-4795-4605-9667-a12b46ec26d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:05.766533 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-6a705989-4795-4605-9667-a12b46ec26d8 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:05.767770 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-6a705989-4795-4605-9667-a12b46ec26d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:05.838521 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 295/585] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:13:05.863404 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a48b3f-3aa2-4b30-8bd1-d326d413167f None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:05.918064 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:05.933807 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39791caf-ce13-4091-83ae-234754a3bd91 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:05.934166 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39791caf-ce13-4091-83ae-234754a3bd91 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:05.934643 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39791caf-ce13-4091-83ae-234754a3bd91 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:05.943157 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 296/586] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:13:05.945244 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fad91-8967-4751-8e05-14a1a0537960 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:05.945730 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fad91-8967-4751-8e05-14a1a0537960 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:05.946204 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fad91-8967-4751-8e05-14a1a0537960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:05.976210 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a48b3f-3aa2-4b30-8bd1-d326d413167f None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:05.980241 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-ea8fad91-8967-4751-8e05-14a1a0537960 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:05.983670 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-ea8fad91-8967-4751-8e05-14a1a0537960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:06.013649 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fd1a8-689a-4783-b0d7-c7090128fabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:06.014684 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fd1a8-689a-4783-b0d7-c7090128fabf None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:06.015784 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fd1a8-689a-4783-b0d7-c7090128fabf None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:06.016266 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fd1a8-689a-4783-b0d7-c7090128fabf None admin] PATH_INFO: `/v3/roles/service` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:06.027511 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12fd1a8-689a-4783-b0d7-c7090128fabf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:13:06.034005 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-c12fd1a8-689a-4783-b0d7-c7090128fabf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:13:06.034005 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:06.034005 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:06.034005 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:06.034005 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:06.034005 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:06.034005 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:06.034005 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:06.034005 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:06.034005 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:06.034005 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:06.034005 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:06.034005 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:13:06.034005 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:13:06.034005 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:13:06.034005 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:13:06.034959 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:13:06.034959 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:13:06.034959 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:13:06.034959 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:13:06.034959 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:06.034959 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:06.034959 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:06.034959 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:06.034959 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:06.034959 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:06.034959 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:06.034959 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:06.034959 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:06.034959 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:06.034959 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:06.034959 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:06.035848 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:06.035848 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:06.035848 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:06.035848 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:06.035848 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:13:06.035848 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:13:06.035848 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:13:06.035848 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:13:06.035848 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:13:06.035848 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:13:06.035848 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:13:06.035848 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:06.038160 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:06.038742 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 291/587] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 16:13:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:06.044938 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fd1a8-689a-4783-b0d7-c7090128fabf None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:06.071409 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 297/588] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:13:06.094796 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fad91-8967-4751-8e05-14a1a0537960 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:06.165661 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fd1a8-689a-4783-b0d7-c7090128fabf None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:06.177381 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:06.216518 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b8516-07fc-44ad-b3e9-2dd0fcd96f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:06.217503 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b8516-07fc-44ad-b3e9-2dd0fcd96f9a None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:06.218005 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b8516-07fc-44ad-b3e9-2dd0fcd96f9a None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:06.219116 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b8516-07fc-44ad-b3e9-2dd0fcd96f9a None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:06.220194 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b8516-07fc-44ad-b3e9-2dd0fcd96f9a None admin] RBAC: Adding query filter params (name=service) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:06.220707 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b8516-07fc-44ad-b3e9-2dd0fcd96f9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:06.222333 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b8516-07fc-44ad-b3e9-2dd0fcd96f9a None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:06.237041 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 292/589] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 16:13:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:13:06.237344 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fad91-8967-4751-8e05-14a1a0537960 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:06.238477 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b8516-07fc-44ad-b3e9-2dd0fcd96f9a None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:06.289484 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4ce15-27a1-4177-aeb6-e5432c74a255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:06.290172 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4ce15-27a1-4177-aeb6-e5432c74a255 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:06.290491 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4ce15-27a1-4177-aeb6-e5432c74a255 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:06.290777 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4ce15-27a1-4177-aeb6-e5432c74a255 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:06.305898 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4ce15-27a1-4177-aeb6-e5432c74a255 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:13:06.312939 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-f7a4ce15-27a1-4177-aeb6-e5432c74a255 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:13:06.312939 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:06.312939 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:06.312939 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:06.312939 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:06.312939 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:06.312939 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:06.312939 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:06.312939 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:06.312939 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:06.312939 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:06.312939 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:06.312939 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:13:06.312939 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:13:06.312939 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:13:06.312939 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:13:06.313912 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:13:06.313912 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:13:06.313912 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:13:06.313912 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:13:06.313912 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:06.313912 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:06.313912 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:06.313912 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:06.313912 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:06.313912 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:06.313912 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:06.313912 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:06.313912 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:06.313912 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:06.313912 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:06.313912 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:06.314774 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:06.314774 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:06.314774 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:06.314774 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:06.314774 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:13:06.314774 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:13:06.314774 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:13:06.314774 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:13:06.314774 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:13:06.314774 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:13:06.314774 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:13:06.314774 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:06.319132 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 298/590] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 16:13:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:13:06.320959 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4ce15-27a1-4177-aeb6-e5432c74a255 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:06.365061 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b8516-07fc-44ad-b3e9-2dd0fcd96f9a None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:06.382060 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:06.404818 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0fb60-69a2-45fc-8395-04a056fe324f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:06.405937 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0fb60-69a2-45fc-8395-04a056fe324f None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:06.406440 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0fb60-69a2-45fc-8395-04a056fe324f None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:06.407032 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0fb60-69a2-45fc-8395-04a056fe324f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:06.419955 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0fb60-69a2-45fc-8395-04a056fe324f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:06.421972 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0fb60-69a2-45fc-8395-04a056fe324f None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:06.436514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-8fe0fb60-69a2-45fc-8395-04a056fe324f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:06.436514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:06.436514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:06.436514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:06.436514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:06.436514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:06.436514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:06.436514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:06.436514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:06.436514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:06.436514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:06.436514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:06.436514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:13:06.436514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:13:06.436514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:13:06.438075 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:13:06.438075 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:06.438075 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:06.438075 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:06.438075 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:06.438075 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:06.438075 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:06.438075 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:06.438075 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:06.438075 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:06.438075 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:06.438075 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:06.438075 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:06.438075 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:06.438075 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:06.438075 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:06.438075 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:06.438972 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:13:06.438972 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:13:06.438972 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:06.438972 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:06.438972 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 293/591] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:06.439777 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0da23-ea36-4c6b-8f26-5bb186fccab9 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:06.439777 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0da23-ea36-4c6b-8f26-5bb186fccab9 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:06.440331 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0da23-ea36-4c6b-8f26-5bb186fccab9 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:06.441744 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 294/592] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:13:06.446118 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0da23-ea36-4c6b-8f26-5bb186fccab9 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:06.454884 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4ce15-27a1-4177-aeb6-e5432c74a255 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:06.471511 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:06.495704 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1210c-be0e-414c-ac56-e460513ccded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:06.495704 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1210c-be0e-414c-ac56-e460513ccded None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:06.495704 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1210c-be0e-414c-ac56-e460513ccded None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:06.496078 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1210c-be0e-414c-ac56-e460513ccded None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:06.496961 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc1210c-be0e-414c-ac56-e460513ccded None admin] RBAC: Adding query filter params (name=service) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:06.497257 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc1210c-be0e-414c-ac56-e460513ccded None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:06.498819 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc1210c-be0e-414c-ac56-e460513ccded None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:06.508361 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 299/593] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 16:13:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:13:06.509584 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786285aa-a4e1-44a9-87a5-cfa68d1f74c7 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:06.509881 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786285aa-a4e1-44a9-87a5-cfa68d1f74c7 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:06.510163 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786285aa-a4e1-44a9-87a5-cfa68d1f74c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:06.527893 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-786285aa-a4e1-44a9-87a5-cfa68d1f74c7 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:06.529072 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-786285aa-a4e1-44a9-87a5-cfa68d1f74c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:06.564431 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0da23-ea36-4c6b-8f26-5bb186fccab9 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:06.600141 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 300/594] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:13:06.600937 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786285aa-a4e1-44a9-87a5-cfa68d1f74c7 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:06.608414 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b718a6-b717-414e-9e75-17b37ca77b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:06.610459 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b718a6-b717-414e-9e75-17b37ca77b3f None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:06.611012 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b718a6-b717-414e-9e75-17b37ca77b3f None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:06.611544 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b718a6-b717-414e-9e75-17b37ca77b3f None admin] PATH_INFO: `/v3/domains` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:06.612985 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b718a6-b717-414e-9e75-17b37ca77b3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:06.613905 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b718a6-b717-414e-9e75-17b37ca77b3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:06.616379 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b718a6-b717-414e-9e75-17b37ca77b3f None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:06.631677 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 295/595] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:13:06.636868 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b718a6-b717-414e-9e75-17b37ca77b3f None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:06.637575 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:06.712690 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786285aa-a4e1-44a9-87a5-cfa68d1f74c7 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:06.737010 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:06.753548 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e98d3-657d-4239-883b-11a8afbf8df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:06.754262 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e98d3-657d-4239-883b-11a8afbf8df4 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:06.754471 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e98d3-657d-4239-883b-11a8afbf8df4 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:06.754747 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e98d3-657d-4239-883b-11a8afbf8df4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:06.758473 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b718a6-b717-414e-9e75-17b37ca77b3f None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:06.765290 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e98d3-657d-4239-883b-11a8afbf8df4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:06.766754 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e98d3-657d-4239-883b-11a8afbf8df4 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:06.784054 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-696e98d3-657d-4239-883b-11a8afbf8df4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:06.784054 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:06.784054 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:06.784054 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:06.784054 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:06.784054 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:06.784054 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:06.784054 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:06.784054 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:06.784054 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:06.784054 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:06.784054 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:06.784054 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:13:06.784054 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:13:06.784054 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:13:06.784991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:13:06.784991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:06.784991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:06.784991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:06.784991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:06.784991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:06.784991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:06.784991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:06.784991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:06.784991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:06.784991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:06.784991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:06.784991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:06.784991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:06.784991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:06.784991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:06.784991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:06.785860 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:13:06.785860 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:13:06.785860 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:06.785860 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:06.785860 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 301/596] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:06.786145 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e98d3-657d-4239-883b-11a8afbf8df4 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:06.800978 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92673259-a683-45f0-87d8-611220f832df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:06.801727 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92673259-a683-45f0-87d8-611220f832df None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:06.802010 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92673259-a683-45f0-87d8-611220f832df None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:06.802285 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92673259-a683-45f0-87d8-611220f832df None admin] PATH_INFO: `/v3/roles/service` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:06.812806 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92673259-a683-45f0-87d8-611220f832df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:13:06.817797 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-92673259-a683-45f0-87d8-611220f832df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:13:06.817797 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:06.817797 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:06.817797 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:06.817797 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:06.817797 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:06.817797 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:06.817797 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:06.817797 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:06.817797 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:06.817797 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:06.817797 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:06.817797 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:13:06.817797 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:13:06.817797 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:13:06.817797 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:13:06.818916 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:13:06.818916 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:13:06.818916 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:13:06.818916 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:13:06.818916 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:06.818916 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:06.818916 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:06.818916 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:06.818916 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:06.818916 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:06.818916 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:06.818916 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:06.818916 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:06.818916 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:06.818916 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:06.818916 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:06.819780 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:06.819780 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:06.819780 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:06.819780 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:06.819780 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:13:06.819780 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:13:06.819780 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:13:06.819780 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:13:06.819780 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:13:06.819780 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:13:06.819780 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:13:06.819780 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:06.819780 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 296/597] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 16:13:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:06.819780 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92673259-a683-45f0-87d8-611220f832df None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:06.890228 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:06.906255 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e98d3-657d-4239-883b-11a8afbf8df4 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:06.935247 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92673259-a683-45f0-87d8-611220f832df None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:06.944554 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59b6d0-3bbe-4be0-bd67-92bcc5a7abba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:06.945444 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59b6d0-3bbe-4be0-bd67-92bcc5a7abba None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:06.945881 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59b6d0-3bbe-4be0-bd67-92bcc5a7abba None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:06.946309 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59b6d0-3bbe-4be0-bd67-92bcc5a7abba None admin] PATH_INFO: `/v3/users/glance` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:06.955321 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59b6d0-3bbe-4be0-bd67-92bcc5a7abba None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:06.957094 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59b6d0-3bbe-4be0-bd67-92bcc5a7abba None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:06.969067 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-1e59b6d0-3bbe-4be0-bd67-92bcc5a7abba None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 16:13:06.969067 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:06.969067 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:06.969067 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:06.969067 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:06.969067 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:06.969067 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:06.969067 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:06.969067 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:06.969067 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:06.969067 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:06.969067 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:06.969067 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:13:06.969067 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:13:06.969067 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:13:06.969067 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:13:06.970154 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:06.970154 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:06.970154 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:13:06.970154 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:13:06.970154 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:13:06.970154 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:13:06.970154 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:06.970154 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:06.970154 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:06.970154 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:06.970154 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:06.970154 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:06.970154 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:06.970154 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:06.970154 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:06.970154 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:06.970154 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:06.970154 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:06.971249 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:06.971249 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:06.971249 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:13:06.971249 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:13:06.971249 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:13:06.971249 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:13:06.971249 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:13:06.971249 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:13:06.971249 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 16:13:06.971249 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:06.971937 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1106e6-f6a0-4012-98c5-34496eb5b902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:06.972476 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1106e6-f6a0-4012-98c5-34496eb5b902 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:06.972759 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1106e6-f6a0-4012-98c5-34496eb5b902 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:06.973062 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1106e6-f6a0-4012-98c5-34496eb5b902 None admin] PATH_INFO: `/v3/domains` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:06.973742 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1106e6-f6a0-4012-98c5-34496eb5b902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:06.973886 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 302/598] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:13:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:06.974048 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1106e6-f6a0-4012-98c5-34496eb5b902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:06.974950 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59b6d0-3bbe-4be0-bd67-92bcc5a7abba None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:06.975414 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1106e6-f6a0-4012-98c5-34496eb5b902 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:06.989825 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 297/599] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:06.990577 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1106e6-f6a0-4012-98c5-34496eb5b902 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:06.993181 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:07.093735 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59b6d0-3bbe-4be0-bd67-92bcc5a7abba None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:07.103330 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1106e6-f6a0-4012-98c5-34496eb5b902 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:07.130954 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4545d1c-9007-4af1-a690-76a2924c5107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:07.131670 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4545d1c-9007-4af1-a690-76a2924c5107 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:07.131965 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4545d1c-9007-4af1-a690-76a2924c5107 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:07.132247 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4545d1c-9007-4af1-a690-76a2924c5107 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:07.132993 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4545d1c-9007-4af1-a690-76a2924c5107 None admin] RBAC: Adding query filter params (name=service) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:07.133308 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4545d1c-9007-4af1-a690-76a2924c5107 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:07.134779 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4545d1c-9007-4af1-a690-76a2924c5107 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:07.143257 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2c890-39c4-4602-8632-129cd45c655a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:07.144093 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2c890-39c4-4602-8632-129cd45c655a None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:07.144382 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2c890-39c4-4602-8632-129cd45c655a None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:07.144658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2c890-39c4-4602-8632-129cd45c655a None admin] PATH_INFO: `/v3/users` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:07.145382 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 303/600] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 16:13:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:07.146173 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4545d1c-9007-4af1-a690-76a2924c5107 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:07.150169 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2c890-39c4-4602-8632-129cd45c655a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:07.150524 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2c890-39c4-4602-8632-129cd45c655a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:07.152119 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2c890-39c4-4602-8632-129cd45c655a None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:07.160329 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:07.177178 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 298/601] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Jul 27 16:13:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:07.177873 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2c890-39c4-4602-8632-129cd45c655a None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:07.246282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:07.266283 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4545d1c-9007-4af1-a690-76a2924c5107 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:07.294081 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2c890-39c4-4602-8632-129cd45c655a None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:07.302600 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba65da-7036-4b2d-b9c1-bc6637785904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:07.303292 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba65da-7036-4b2d-b9c1-bc6637785904 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:07.303577 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba65da-7036-4b2d-b9c1-bc6637785904 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:07.303865 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba65da-7036-4b2d-b9c1-bc6637785904 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:07.311951 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba65da-7036-4b2d-b9c1-bc6637785904 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:07.313438 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba65da-7036-4b2d-b9c1-bc6637785904 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:07.324818 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-a7ba65da-7036-4b2d-b9c1-bc6637785904 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 16:13:07.324818 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:07.324818 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:07.324818 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:07.324818 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:07.324818 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:07.324818 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:07.324818 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:07.324818 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:07.324818 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:07.324818 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:07.324818 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:07.324818 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:13:07.324818 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:13:07.324818 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:13:07.324818 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:13:07.325748 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:07.325748 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:07.325748 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:13:07.325748 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:13:07.325748 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:13:07.325748 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:13:07.325748 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:07.325748 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:07.325748 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:07.325748 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:07.325748 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:07.325748 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:07.325748 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:07.325748 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:07.325748 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:07.325748 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:07.325748 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:07.325748 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:07.326683 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:07.326683 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:07.326683 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:13:07.326683 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:13:07.326683 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:13:07.326683 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:13:07.326683 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:13:07.326683 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:13:07.326683 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 16:13:07.326683 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:07.326683 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 304/602] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Jul 27 16:13:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:07.327268 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba65da-7036-4b2d-b9c1-bc6637785904 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:07.334006 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449098e1-907d-4b98-a448-a117e86204d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:07.334655 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449098e1-907d-4b98-a448-a117e86204d6 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:07.334940 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449098e1-907d-4b98-a448-a117e86204d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:07.335220 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449098e1-907d-4b98-a448-a117e86204d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:07.346013 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449098e1-907d-4b98-a448-a117e86204d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:07.347470 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449098e1-907d-4b98-a448-a117e86204d6 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:07.362165 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-449098e1-907d-4b98-a448-a117e86204d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:07.362165 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:07.362165 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:07.362165 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:07.362165 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:07.362165 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:07.362165 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:07.362165 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:07.362165 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:07.362165 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:07.362165 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:07.362165 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:07.362165 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:13:07.362165 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:13:07.362165 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:13:07.363200 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:13:07.363200 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:07.363200 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:07.363200 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:07.363200 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:07.363200 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:07.363200 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:07.363200 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:07.363200 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:07.363200 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:07.363200 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:07.363200 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:07.363200 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:07.363200 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:07.363200 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:07.363200 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:07.363200 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:07.368828 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:13:07.368828 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:13:07.368828 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:07.368828 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:07.368828 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 299/603] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:13:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:07.368828 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a4e0b-1f53-4b35-a499-9d48addaee4d None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:07.368828 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a4e0b-1f53-4b35-a499-9d48addaee4d None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:07.368828 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a4e0b-1f53-4b35-a499-9d48addaee4d None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:07.368828 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 300/604] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:13:07.369467 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a4e0b-1f53-4b35-a499-9d48addaee4d None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:07.401337 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:07.436550 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba65da-7036-4b2d-b9c1-bc6637785904 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:07.469857 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d91db-a487-4ae3-991b-12cc386b4a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:07.470477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d91db-a487-4ae3-991b-12cc386b4a65 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:07.470761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d91db-a487-4ae3-991b-12cc386b4a65 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:07.471035 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d91db-a487-4ae3-991b-12cc386b4a65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:07.474138 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a4e0b-1f53-4b35-a499-9d48addaee4d None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:07.487016 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:07.508888 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59254b5-4d5f-4be0-84c5-ef67b0583d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:07.509436 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59254b5-4d5f-4be0-84c5-ef67b0583d33 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:07.509739 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59254b5-4d5f-4be0-84c5-ef67b0583d33 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:07.510004 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59254b5-4d5f-4be0-84c5-ef67b0583d33 None admin] PATH_INFO: `/v3/users` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:07.510814 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59254b5-4d5f-4be0-84c5-ef67b0583d33 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:07.511225 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59254b5-4d5f-4be0-84c5-ef67b0583d33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:07.512772 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59254b5-4d5f-4be0-84c5-ef67b0583d33 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:07.532090 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 301/605] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Jul 27 16:13:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:07.532921 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59254b5-4d5f-4be0-84c5-ef67b0583d33 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:07.538729 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d91db-a487-4ae3-991b-12cc386b4a65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:07.540467 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d91db-a487-4ae3-991b-12cc386b4a65 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:07.604024 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:07.632285 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59254b5-4d5f-4be0-84c5-ef67b0583d33 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:07.639096 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 305/606] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:13:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:13:07.641052 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8acec70-15db-4c5d-92fd-96081918cab1 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:07.641344 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8acec70-15db-4c5d-92fd-96081918cab1 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:07.641626 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8acec70-15db-4c5d-92fd-96081918cab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:07.659814 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-d8acec70-15db-4c5d-92fd-96081918cab1 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:07.661004 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-d8acec70-15db-4c5d-92fd-96081918cab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:07.666779 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938f613-9963-4784-a634-e275f10f2d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:07.667511 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938f613-9963-4784-a634-e275f10f2d35 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:07.667859 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938f613-9963-4784-a634-e275f10f2d35 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:07.668201 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938f613-9963-4784-a634-e275f10f2d35 None admin] PATH_INFO: `/v3/domains` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:07.668959 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938f613-9963-4784-a634-e275f10f2d35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:07.669257 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938f613-9963-4784-a634-e275f10f2d35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:07.670632 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938f613-9963-4784-a634-e275f10f2d35 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:07.682951 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 302/607] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:07.683800 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938f613-9963-4784-a634-e275f10f2d35 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:07.715738 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:07.734062 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 306/608] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:13:07.734908 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8acec70-15db-4c5d-92fd-96081918cab1 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:07.797665 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938f613-9963-4784-a634-e275f10f2d35 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:07.833095 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda2d82-d38e-4a06-9c8b-7887243ca66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:07.833711 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda2d82-d38e-4a06-9c8b-7887243ca66d None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:07.833991 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda2d82-d38e-4a06-9c8b-7887243ca66d None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:07.834268 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda2d82-d38e-4a06-9c8b-7887243ca66d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:07.836440 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:07.840592 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8acec70-15db-4c5d-92fd-96081918cab1 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:07.876064 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d96b69-fdf7-4104-9122-00cb52d17c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:07.876703 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d96b69-fdf7-4104-9122-00cb52d17c8d None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:07.876981 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d96b69-fdf7-4104-9122-00cb52d17c8d None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:07.877253 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d96b69-fdf7-4104-9122-00cb52d17c8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:07.887621 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d96b69-fdf7-4104-9122-00cb52d17c8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:07.889073 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d96b69-fdf7-4104-9122-00cb52d17c8d None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:07.903870 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda2d82-d38e-4a06-9c8b-7887243ca66d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:07.905312 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda2d82-d38e-4a06-9c8b-7887243ca66d None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:07.905671 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-e0d96b69-fdf7-4104-9122-00cb52d17c8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:07.905671 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:07.905671 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:07.905671 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:07.905671 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:07.905671 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:07.905671 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:07.905671 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:07.905671 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:07.905671 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:07.905671 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:07.905671 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:07.905671 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:13:07.905671 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:13:07.905671 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:13:07.907264 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:13:07.907264 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:07.907264 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:07.907264 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:07.907264 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:07.907264 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:07.907264 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:07.907264 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:07.907264 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:07.907264 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:07.907264 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:07.907264 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:07.907264 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:07.907264 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:07.907264 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:07.907264 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:07.907264 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:07.913154 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:13:07.913154 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:13:07.913154 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:07.913154 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:07.913154 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 307/609] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:13:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:07.913154 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d96b69-fdf7-4104-9122-00cb52d17c8d None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:07.942271 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:08.010703 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d96b69-fdf7-4104-9122-00cb52d17c8d None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:08.016364 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 303/610] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:13:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:13:08.016364 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda2d82-d38e-4a06-9c8b-7887243ca66d None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:08.048910 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b77e30-0836-4457-a7bf-e775f49ff65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:08.049480 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b77e30-0836-4457-a7bf-e775f49ff65c None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:08.049760 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b77e30-0836-4457-a7bf-e775f49ff65c None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:08.050033 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b77e30-0836-4457-a7bf-e775f49ff65c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:08.057605 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b77e30-0836-4457-a7bf-e775f49ff65c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:08.059031 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b77e30-0836-4457-a7bf-e775f49ff65c None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:08.070058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-31b77e30-0836-4457-a7bf-e775f49ff65c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 16:13:08.070058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:08.070058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:08.070058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:08.070058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:08.070058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:08.070058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:08.070058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:08.070058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:08.070058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:08.070058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:08.070058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:08.070058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:13:08.070058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:13:08.070058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:13:08.070058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:13:08.071051 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:08.071051 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:08.071051 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:13:08.071051 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:13:08.071051 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:13:08.071051 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:13:08.071051 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:08.071051 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:08.071051 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:08.071051 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:08.071051 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:08.071051 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:08.071051 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:08.071051 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:08.071051 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:08.071051 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:08.071051 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:08.071051 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:08.072061 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:08.072061 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:08.072061 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:13:08.072061 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:13:08.072061 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:13:08.072061 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:13:08.072061 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:13:08.072061 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:13:08.072061 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 16:13:08.072061 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:08.072061 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 308/611] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:13:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:08.072061 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b77e30-0836-4457-a7bf-e775f49ff65c None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:08.086139 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:08.118322 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda2d82-d38e-4a06-9c8b-7887243ca66d None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:08.147559 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:08.154083 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e9ff4-6558-419c-b293-15cb03cb4b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:08.154734 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e9ff4-6558-419c-b293-15cb03cb4b0b None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:08.155016 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e9ff4-6558-419c-b293-15cb03cb4b0b None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:08.155303 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e9ff4-6558-419c-b293-15cb03cb4b0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:08.166244 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e9ff4-6558-419c-b293-15cb03cb4b0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:13:08.171567 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-db3e9ff4-6558-419c-b293-15cb03cb4b0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:13:08.171567 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:08.171567 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:08.171567 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:08.171567 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:08.171567 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:08.171567 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:08.171567 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:08.171567 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:08.171567 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:08.171567 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:08.171567 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:08.171567 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:13:08.171567 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:13:08.171567 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:13:08.171567 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:13:08.172510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:13:08.172510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:13:08.172510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:13:08.172510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:13:08.172510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:08.172510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:08.172510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:08.172510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:08.172510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:08.172510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:08.172510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:08.172510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:08.172510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:08.172510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:08.172510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:08.172510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:08.173347 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:08.173347 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:08.173347 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:08.173347 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:08.173347 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:13:08.173347 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:13:08.173347 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:13:08.173347 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:13:08.173347 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:13:08.173347 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:13:08.173347 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:13:08.173347 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:08.173347 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 304/612] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 16:13:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:08.176444 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b77e30-0836-4457-a7bf-e775f49ff65c None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:08.178425 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e9ff4-6558-419c-b293-15cb03cb4b0b None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:08.216355 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3f582-84f7-4bca-ad48-3a243e7881df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:08.217445 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3f582-84f7-4bca-ad48-3a243e7881df None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:08.217947 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3f582-84f7-4bca-ad48-3a243e7881df None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:08.219108 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3f582-84f7-4bca-ad48-3a243e7881df None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:08.220360 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3f582-84f7-4bca-ad48-3a243e7881df None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:08.220699 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3f582-84f7-4bca-ad48-3a243e7881df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:08.222542 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3f582-84f7-4bca-ad48-3a243e7881df None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:08.234626 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 309/613] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:08.235456 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3f582-84f7-4bca-ad48-3a243e7881df None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:08.288505 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e9ff4-6558-419c-b293-15cb03cb4b0b None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:08.311565 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:08.327004 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ebf58-5ead-4874-9a8f-e5a28f23424b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:08.328234 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ebf58-5ead-4874-9a8f-e5a28f23424b None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:08.328515 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ebf58-5ead-4874-9a8f-e5a28f23424b None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:08.328786 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ebf58-5ead-4874-9a8f-e5a28f23424b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:08.338659 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ebf58-5ead-4874-9a8f-e5a28f23424b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:08.340124 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ebf58-5ead-4874-9a8f-e5a28f23424b None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:08.343562 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3f582-84f7-4bca-ad48-3a243e7881df None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:08.354426 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-0c1ebf58-5ead-4874-9a8f-e5a28f23424b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:08.354426 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:08.354426 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:08.354426 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:08.354426 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:08.354426 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:08.354426 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:08.354426 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:08.354426 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:08.354426 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:08.354426 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:08.354426 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:08.354426 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:13:08.354426 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:13:08.354426 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:13:08.355527 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:13:08.355527 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:08.355527 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:08.355527 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:08.355527 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:08.355527 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:08.355527 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:08.355527 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:08.355527 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:08.355527 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:08.355527 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:08.355527 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:08.355527 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:08.355527 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:08.355527 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:08.355527 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:08.355527 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:08.356673 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:13:08.356673 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:13:08.356673 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:08.356673 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:08.356673 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 305/614] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:13:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:08.356673 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ebf58-5ead-4874-9a8f-e5a28f23424b None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:08.381829 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543e20f-0ab1-46a8-95ae-381e0e8bf761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:08.382470 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543e20f-0ab1-46a8-95ae-381e0e8bf761 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:08.382738 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543e20f-0ab1-46a8-95ae-381e0e8bf761 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:08.383017 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543e20f-0ab1-46a8-95ae-381e0e8bf761 None admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:08.383857 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543e20f-0ab1-46a8-95ae-381e0e8bf761 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:08.384169 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543e20f-0ab1-46a8-95ae-381e0e8bf761 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:08.385640 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543e20f-0ab1-46a8-95ae-381e0e8bf761 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:08.400423 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:08.403098 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 310/615] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Jul 27 16:13:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:08.403963 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543e20f-0ab1-46a8-95ae-381e0e8bf761 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:08.461896 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ebf58-5ead-4874-9a8f-e5a28f23424b None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:08.495349 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b5bb3-0158-404d-ac32-4c44e0808f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:08.496013 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b5bb3-0158-404d-ac32-4c44e0808f40 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:08.496303 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b5bb3-0158-404d-ac32-4c44e0808f40 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:08.496579 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b5bb3-0158-404d-ac32-4c44e0808f40 None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:08.497300 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b5bb3-0158-404d-ac32-4c44e0808f40 None admin] RBAC: Adding query filter params (name=service) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:08.497615 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b5bb3-0158-404d-ac32-4c44e0808f40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:08.498973 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b5bb3-0158-404d-ac32-4c44e0808f40 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:08.506512 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543e20f-0ab1-46a8-95ae-381e0e8bf761 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:08.507473 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 306/616] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 16:13:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:08.512713 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b5bb3-0158-404d-ac32-4c44e0808f40 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:08.534128 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:08.542508 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e91e1a-98e8-470d-b6ea-0e32b8048c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:08.543153 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e91e1a-98e8-470d-b6ea-0e32b8048c69 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:08.543475 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e91e1a-98e8-470d-b6ea-0e32b8048c69 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:08.543753 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e91e1a-98e8-470d-b6ea-0e32b8048c69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:08.550404 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e91e1a-98e8-470d-b6ea-0e32b8048c69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:08.551898 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e91e1a-98e8-470d-b6ea-0e32b8048c69 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:08.564347 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-23e91e1a-98e8-470d-b6ea-0e32b8048c69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:13:08.564347 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:08.564347 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:08.564347 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:08.564347 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:08.564347 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:08.564347 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:08.564347 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:08.564347 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:08.564347 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:08.564347 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:08.564347 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:08.564347 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:13:08.564347 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:13:08.564347 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:13:08.565560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:13:08.565560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:08.565560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:08.565560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:08.565560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:08.565560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:08.565560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:08.565560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:08.565560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:08.565560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:08.565560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:08.565560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:08.565560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:08.565560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:08.565560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:08.565560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:08.565560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:08.566631 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:13:08.566631 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:13:08.566631 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:13:08.566631 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:13:08.566631 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:13:08.566631 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:13:08.566631 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:13:08.566631 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:08.566631 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 311/617] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:13:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:08.566631 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e91e1a-98e8-470d-b6ea-0e32b8048c69 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:08.615091 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b5bb3-0158-404d-ac32-4c44e0808f40 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:08.617408 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:08.649645 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c7345-32e5-4417-9581-eef348263753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:08.650350 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c7345-32e5-4417-9581-eef348263753 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:08.650707 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c7345-32e5-4417-9581-eef348263753 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:08.651078 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c7345-32e5-4417-9581-eef348263753 None admin] PATH_INFO: `/v3/domains` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:08.651848 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c7345-32e5-4417-9581-eef348263753 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:08.652229 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c7345-32e5-4417-9581-eef348263753 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:08.653657 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c7345-32e5-4417-9581-eef348263753 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:08.665617 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 307/618] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:08.670471 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c7345-32e5-4417-9581-eef348263753 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:08.678221 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e91e1a-98e8-470d-b6ea-0e32b8048c69 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:08.714091 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8805e7-06ee-4afa-a4ad-df5614b0788a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:08.714700 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8805e7-06ee-4afa-a4ad-df5614b0788a None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:08.714983 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8805e7-06ee-4afa-a4ad-df5614b0788a None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:08.715254 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8805e7-06ee-4afa-a4ad-df5614b0788a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:08.768265 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c7345-32e5-4417-9581-eef348263753 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:08.770718 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:08.782899 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8805e7-06ee-4afa-a4ad-df5614b0788a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:08.784396 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8805e7-06ee-4afa-a4ad-df5614b0788a None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:08.803157 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5275277-5aee-4b2a-bf7b-1ec3b9892ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:08.803827 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5275277-5aee-4b2a-bf7b-1ec3b9892ca1 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:08.804106 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5275277-5aee-4b2a-bf7b-1ec3b9892ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:08.804381 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5275277-5aee-4b2a-bf7b-1ec3b9892ca1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:08.814721 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5275277-5aee-4b2a-bf7b-1ec3b9892ca1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:08.816145 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5275277-5aee-4b2a-bf7b-1ec3b9892ca1 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:08.831261 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-e5275277-5aee-4b2a-bf7b-1ec3b9892ca1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:08.831261 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:08.831261 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:08.831261 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:08.831261 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:08.831261 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:08.831261 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:08.831261 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:08.831261 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:08.831261 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:08.831261 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:08.831261 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:08.831261 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:13:08.831261 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:13:08.831261 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:13:08.832304 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:13:08.832304 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:08.832304 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:08.832304 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:08.832304 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:08.832304 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:08.832304 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:08.832304 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:08.832304 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:08.832304 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:08.832304 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:08.832304 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:08.832304 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:08.832304 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:08.832304 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:08.832304 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:08.832304 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:08.833307 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:13:08.833307 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:13:08.833307 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:08.833307 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:08.833307 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 308/619] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:13:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:08.833632 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5275277-5aee-4b2a-bf7b-1ec3b9892ca1 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:08.852350 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:08.887842 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 312/620] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:13:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:13:08.888804 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8805e7-06ee-4afa-a4ad-df5614b0788a None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:08.936441 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5275277-5aee-4b2a-bf7b-1ec3b9892ca1 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:08.970897 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98b0ab-fafa-4df8-a61b-01bb3690691c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:08.971534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98b0ab-fafa-4df8-a61b-01bb3690691c None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:08.971822 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98b0ab-fafa-4df8-a61b-01bb3690691c None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:08.972100 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98b0ab-fafa-4df8-a61b-01bb3690691c None admin] PATH_INFO: `/v3/projects` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:08.972831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98b0ab-fafa-4df8-a61b-01bb3690691c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:08.973135 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98b0ab-fafa-4df8-a61b-01bb3690691c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:08.974556 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98b0ab-fafa-4df8-a61b-01bb3690691c None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:08.978835 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:08.987661 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 309/621] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 16:13:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:08.988465 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98b0ab-fafa-4df8-a61b-01bb3690691c None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:08.991909 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8805e7-06ee-4afa-a4ad-df5614b0788a None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:09.025649 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8748e9f-49ee-4323-8661-cef2cf2387c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:09.026288 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8748e9f-49ee-4323-8661-cef2cf2387c1 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:09.026571 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8748e9f-49ee-4323-8661-cef2cf2387c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:09.026830 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8748e9f-49ee-4323-8661-cef2cf2387c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:09.034109 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8748e9f-49ee-4323-8661-cef2cf2387c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:09.035591 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8748e9f-49ee-4323-8661-cef2cf2387c1 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:09.047729 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-d8748e9f-49ee-4323-8661-cef2cf2387c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:13:09.047729 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:09.047729 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:09.047729 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:09.047729 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:09.047729 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:09.047729 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:09.047729 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:09.047729 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:09.047729 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:09.047729 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:09.047729 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:09.047729 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:13:09.047729 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:13:09.047729 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:13:09.048656 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:13:09.048656 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:09.048656 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:09.048656 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:09.048656 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:09.048656 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:09.048656 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:09.048656 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:09.048656 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:09.048656 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:09.048656 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:09.048656 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:09.048656 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:09.048656 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:09.048656 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:09.048656 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:09.048656 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:09.049531 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:13:09.049531 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:13:09.049531 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:13:09.049531 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:13:09.049531 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:13:09.049531 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:13:09.049531 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:13:09.049531 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:09.049531 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 313/622] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:13:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:09.050032 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8748e9f-49ee-4323-8661-cef2cf2387c1 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:09.071871 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:09.095837 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98b0ab-fafa-4df8-a61b-01bb3690691c None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:09.129950 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c366e7-ed83-4bfe-bc7d-ae4a97f71ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:09.130569 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c366e7-ed83-4bfe-bc7d-ae4a97f71ce5 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:09.130852 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c366e7-ed83-4bfe-bc7d-ae4a97f71ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:09.131129 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c366e7-ed83-4bfe-bc7d-ae4a97f71ce5 None admin] PATH_INFO: `/v3/domains` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:09.131845 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c366e7-ed83-4bfe-bc7d-ae4a97f71ce5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:09.132153 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c366e7-ed83-4bfe-bc7d-ae4a97f71ce5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:09.133546 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c366e7-ed83-4bfe-bc7d-ae4a97f71ce5 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:09.145541 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 310/623] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:09.146334 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c366e7-ed83-4bfe-bc7d-ae4a97f71ce5 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:09.149332 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8748e9f-49ee-4323-8661-cef2cf2387c1 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:09.182298 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93366960-9335-4344-a319-022f90e0ea6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:09.182943 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93366960-9335-4344-a319-022f90e0ea6e None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:09.183227 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93366960-9335-4344-a319-022f90e0ea6e None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:09.183535 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93366960-9335-4344-a319-022f90e0ea6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:09.194266 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93366960-9335-4344-a319-022f90e0ea6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:09.195757 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93366960-9335-4344-a319-022f90e0ea6e None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:09.204146 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:09.211225 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-93366960-9335-4344-a319-022f90e0ea6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:09.211225 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:09.211225 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:09.211225 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:09.211225 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:09.211225 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:09.211225 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:09.211225 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:09.211225 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:09.211225 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:09.211225 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:09.211225 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:09.211225 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:13:09.211225 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:13:09.211225 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:13:09.212444 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:13:09.212444 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:09.212444 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:09.212444 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:09.212444 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:09.212444 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:09.212444 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:09.212444 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:09.212444 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:09.212444 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:09.212444 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:09.212444 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:09.212444 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:09.212444 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:09.212444 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:09.212444 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:09.212444 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:09.213521 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:13:09.213521 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:13:09.213521 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:09.213521 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:09.217513 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 314/624] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:13:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:09.218198 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93366960-9335-4344-a319-022f90e0ea6e None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:09.251509 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c366e7-ed83-4bfe-bc7d-ae4a97f71ce5 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:09.286474 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726bfc51-8eae-4c25-a352-129f73e923d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:09.287088 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726bfc51-8eae-4c25-a352-129f73e923d6 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:09.287407 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726bfc51-8eae-4c25-a352-129f73e923d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:09.287672 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726bfc51-8eae-4c25-a352-129f73e923d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:09.288457 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726bfc51-8eae-4c25-a352-129f73e923d6 None admin] RBAC: Adding query filter params (role.id=738aa511871f47acb7169da7e104be79, scope.project.id=73d63a3d7b724a5998ea2976430f242d, user.id=43377fb5ab3c4ddfb54b3b2cae8eb351) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:09.288765 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726bfc51-8eae-4c25-a352-129f73e923d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:09.290452 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726bfc51-8eae-4c25-a352-129f73e923d6 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:09.293404 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:09.298199 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 311/625] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 16:13:09 2022] GET /identity/v3/role_assignments?user.id=43377fb5ab3c4ddfb54b3b2cae8eb351&scope.project.id=73d63a3d7b724a5998ea2976430f242d&role.id=738aa511871f47acb7169da7e104be79 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:09.299489 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726bfc51-8eae-4c25-a352-129f73e923d6 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:09.333919 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93366960-9335-4344-a319-022f90e0ea6e None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:09.372238 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a28460-9ed4-4fa7-8649-f04c9b63fc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:09.372878 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a28460-9ed4-4fa7-8649-f04c9b63fc10 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:09.373165 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a28460-9ed4-4fa7-8649-f04c9b63fc10 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:09.373449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a28460-9ed4-4fa7-8649-f04c9b63fc10 None admin] PATH_INFO: `/v3/projects` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:09.374236 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a28460-9ed4-4fa7-8649-f04c9b63fc10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:09.375150 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a28460-9ed4-4fa7-8649-f04c9b63fc10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:09.376799 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a28460-9ed4-4fa7-8649-f04c9b63fc10 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:09.390066 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 315/626] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 16:13:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:09.396513 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a28460-9ed4-4fa7-8649-f04c9b63fc10 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:09.433372 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726bfc51-8eae-4c25-a352-129f73e923d6 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:09.468437 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:09.479664 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e538b3-33d4-4b58-8ce1-de4f14a4ea7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:09.480319 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e538b3-33d4-4b58-8ce1-de4f14a4ea7b None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:09.480602 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e538b3-33d4-4b58-8ce1-de4f14a4ea7b None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:09.480878 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e538b3-33d4-4b58-8ce1-de4f14a4ea7b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:09.492763 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e538b3-33d4-4b58-8ce1-de4f14a4ea7b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:09.494215 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e538b3-33d4-4b58-8ce1-de4f14a4ea7b None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:09.506813 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-60e538b3-33d4-4b58-8ce1-de4f14a4ea7b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 16:13:09.506813 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:09.506813 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:09.506813 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:09.506813 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:09.506813 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:09.506813 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:09.506813 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:09.506813 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:09.506813 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:09.506813 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:09.506813 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:09.506813 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:13:09.506813 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:13:09.506813 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:13:09.506813 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:13:09.507868 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:09.507868 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:09.507868 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:13:09.507868 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:13:09.507868 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:13:09.507868 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:13:09.507868 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:09.507868 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:09.507868 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:09.507868 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:09.507868 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:09.507868 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:09.507868 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:09.507868 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:09.507868 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:09.507868 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:09.507868 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:09.507868 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:09.508816 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:09.508816 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:09.508816 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:13:09.508816 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:13:09.508816 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:13:09.508816 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:13:09.508816 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:13:09.508816 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:13:09.508816 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 16:13:09.508816 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:09.511470 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 312/627] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 16:13:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:09.512494 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e538b3-33d4-4b58-8ce1-de4f14a4ea7b None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:09.523009 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a28460-9ed4-4fa7-8649-f04c9b63fc10 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:09.565269 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426e422-6782-42dc-820f-045c24d979c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:09.566047 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426e422-6782-42dc-820f-045c24d979c3 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:09.566428 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426e422-6782-42dc-820f-045c24d979c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:09.566799 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426e422-6782-42dc-820f-045c24d979c3 None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:09.567622 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426e422-6782-42dc-820f-045c24d979c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:09.568036 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426e422-6782-42dc-820f-045c24d979c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:09.569495 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426e422-6782-42dc-820f-045c24d979c3 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:09.580240 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:09.582098 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 316/628] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:09.583027 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426e422-6782-42dc-820f-045c24d979c3 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:09.627514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e538b3-33d4-4b58-8ce1-de4f14a4ea7b None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:09.663721 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09723bfd-e941-4a19-8da3-c4c83a05e20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:09.664639 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09723bfd-e941-4a19-8da3-c4c83a05e20d None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:09.664924 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09723bfd-e941-4a19-8da3-c4c83a05e20d None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:09.665208 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09723bfd-e941-4a19-8da3-c4c83a05e20d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:09.666345 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09723bfd-e941-4a19-8da3-c4c83a05e20d None admin] RBAC: Adding query filter params (role.id=738aa511871f47acb7169da7e104be79, scope.project.id=73d63a3d7b724a5998ea2976430f242d, user.id=66768f9443c046b3bd75853a4b2b980e) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:09.666666 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09723bfd-e941-4a19-8da3-c4c83a05e20d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:09.668130 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09723bfd-e941-4a19-8da3-c4c83a05e20d None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:09.687717 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 313/629] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 16:13:09 2022] GET /identity/v3/role_assignments?user.id=66768f9443c046b3bd75853a4b2b980e&scope.project.id=73d63a3d7b724a5998ea2976430f242d&role.id=738aa511871f47acb7169da7e104be79 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:09.687717 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09723bfd-e941-4a19-8da3-c4c83a05e20d None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:09.693987 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426e422-6782-42dc-820f-045c24d979c3 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:09.718122 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:09.740698 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe3045-4240-4cd2-9597-d58ce0748806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:09.742491 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe3045-4240-4cd2-9597-d58ce0748806 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:09.742856 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe3045-4240-4cd2-9597-d58ce0748806 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:09.743211 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe3045-4240-4cd2-9597-d58ce0748806 None admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:09.744190 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe3045-4240-4cd2-9597-d58ce0748806 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:09.744578 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe3045-4240-4cd2-9597-d58ce0748806 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:09.746145 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe3045-4240-4cd2-9597-d58ce0748806 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:09.772139 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 317/630] 10.222.0.65 () {56 vars in 1139 bytes} [Wed Jul 27 16:13:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:09.778295 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe3045-4240-4cd2-9597-d58ce0748806 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:09.838944 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09723bfd-e941-4a19-8da3-c4c83a05e20d None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:09.867123 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:09.884185 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c14ef-1d7d-4b1f-8296-0268a9a70830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:09.884773 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c14ef-1d7d-4b1f-8296-0268a9a70830 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:09.885060 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c14ef-1d7d-4b1f-8296-0268a9a70830 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:09.885332 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c14ef-1d7d-4b1f-8296-0268a9a70830 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:09.894700 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c14ef-1d7d-4b1f-8296-0268a9a70830 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:09.896219 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c14ef-1d7d-4b1f-8296-0268a9a70830 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:09.909648 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-350c14ef-1d7d-4b1f-8296-0268a9a70830 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:13:09.909648 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:09.909648 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:09.909648 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:09.909648 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:09.909648 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:09.909648 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:09.909648 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:09.909648 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:09.909648 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:09.909648 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:09.909648 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:09.909648 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:13:09.909648 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:13:09.909648 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:13:09.910583 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:13:09.910583 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:09.910583 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:09.910583 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:09.910583 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:09.910583 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:09.910583 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:09.910583 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:09.910583 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:09.910583 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:09.910583 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:09.910583 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:09.910583 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:09.910583 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:09.910583 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:09.910583 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:09.910583 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:09.911503 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:13:09.911503 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:13:09.911503 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:13:09.911503 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:13:09.911503 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:13:09.911503 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:13:09.911503 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:13:09.911503 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:09.913661 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 314/631] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:13:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:09.920549 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c14ef-1d7d-4b1f-8296-0268a9a70830 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:09.933777 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe3045-4240-4cd2-9597-d58ce0748806 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:09.986956 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542fdb2-be5a-44d0-a6ef-9bf24f4daadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:09.987695 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542fdb2-be5a-44d0-a6ef-9bf24f4daadb None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:09.987904 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542fdb2-be5a-44d0-a6ef-9bf24f4daadb None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:09.988185 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542fdb2-be5a-44d0-a6ef-9bf24f4daadb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:10.037372 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:10.066499 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542fdb2-be5a-44d0-a6ef-9bf24f4daadb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:10.067559 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c14ef-1d7d-4b1f-8296-0268a9a70830 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:10.068083 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542fdb2-be5a-44d0-a6ef-9bf24f4daadb None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:10.106602 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44591a-f12a-4fc8-bc57-7805ba03734d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:10.107252 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44591a-f12a-4fc8-bc57-7805ba03734d None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:10.107705 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44591a-f12a-4fc8-bc57-7805ba03734d None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:10.107987 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44591a-f12a-4fc8-bc57-7805ba03734d None admin] PATH_INFO: `/v3/projects` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:10.109667 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44591a-f12a-4fc8-bc57-7805ba03734d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:10.109998 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44591a-f12a-4fc8-bc57-7805ba03734d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:10.111816 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44591a-f12a-4fc8-bc57-7805ba03734d None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:10.133302 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 315/632] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 16:13:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:13:10.134728 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44591a-f12a-4fc8-bc57-7805ba03734d None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:10.187576 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:10.193705 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 318/633] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:13:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:13:10.198849 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542fdb2-be5a-44d0-a6ef-9bf24f4daadb None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:10.248677 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44591a-f12a-4fc8-bc57-7805ba03734d None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:10.283459 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:10.289185 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbb798-e926-40c7-8c76-9a3fe5da1537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:10.290575 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbb798-e926-40c7-8c76-9a3fe5da1537 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:10.291168 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbb798-e926-40c7-8c76-9a3fe5da1537 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:10.291673 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbb798-e926-40c7-8c76-9a3fe5da1537 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:10.292662 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbb798-e926-40c7-8c76-9a3fe5da1537 None admin] RBAC: Adding query filter params (role.id=738aa511871f47acb7169da7e104be79, scope.project.id=73d63a3d7b724a5998ea2976430f242d, user.id=4b6d1f7acba3415f84c2f01b66190b8a) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:10.293174 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbb798-e926-40c7-8c76-9a3fe5da1537 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:10.294926 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbb798-e926-40c7-8c76-9a3fe5da1537 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:10.307612 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542fdb2-be5a-44d0-a6ef-9bf24f4daadb None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:10.308002 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 316/634] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 16:13:10 2022] GET /identity/v3/role_assignments?user.id=4b6d1f7acba3415f84c2f01b66190b8a&scope.project.id=73d63a3d7b724a5998ea2976430f242d&role.id=738aa511871f47acb7169da7e104be79 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:10.346951 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1414b7-7fdc-4250-943a-c289d3c5e43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:10.347648 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1414b7-7fdc-4250-943a-c289d3c5e43e None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:10.347941 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1414b7-7fdc-4250-943a-c289d3c5e43e None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:10.348187 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1414b7-7fdc-4250-943a-c289d3c5e43e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:10.362257 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1414b7-7fdc-4250-943a-c289d3c5e43e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:10.363756 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1414b7-7fdc-4250-943a-c289d3c5e43e None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:10.380223 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-ea1414b7-7fdc-4250-943a-c289d3c5e43e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:10.380223 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:10.380223 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:10.380223 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:10.380223 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:10.380223 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:10.380223 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:10.380223 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:10.380223 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:10.380223 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:10.380223 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:10.380223 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:10.380223 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:13:10.380223 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:13:10.380223 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:13:10.381180 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:13:10.381180 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:10.381180 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:10.381180 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:10.381180 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:10.381180 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:10.381180 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:10.381180 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:10.381180 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:10.381180 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:10.381180 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:10.381180 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:10.381180 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:10.381180 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:10.381180 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:10.381180 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:10.381180 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:10.382063 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:13:10.382063 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:13:10.382063 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:10.382063 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:10.382063 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 319/635] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:10.387958 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbb798-e926-40c7-8c76-9a3fe5da1537 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:10.510787 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbb798-e926-40c7-8c76-9a3fe5da1537 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:10.523262 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:10.554766 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b11c3-b44d-4a38-8e4b-20b367584318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:10.555418 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b11c3-b44d-4a38-8e4b-20b367584318 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:10.555710 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b11c3-b44d-4a38-8e4b-20b367584318 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:10.555987 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b11c3-b44d-4a38-8e4b-20b367584318 None admin] PATH_INFO: `/v3/domains` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:10.556686 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b11c3-b44d-4a38-8e4b-20b367584318 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:10.556993 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b11c3-b44d-4a38-8e4b-20b367584318 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:10.558364 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b11c3-b44d-4a38-8e4b-20b367584318 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:10.571873 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 317/636] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:10.577246 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1414b7-7fdc-4250-943a-c289d3c5e43e None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:10.695502 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1414b7-7fdc-4250-943a-c289d3c5e43e None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:10.726410 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:10.734050 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a27150-0e29-4632-b71c-00c7894b7228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:10.734744 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a27150-0e29-4632-b71c-00c7894b7228 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:10.735047 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a27150-0e29-4632-b71c-00c7894b7228 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:10.735348 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a27150-0e29-4632-b71c-00c7894b7228 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:10.744589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a27150-0e29-4632-b71c-00c7894b7228 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:10.746897 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a27150-0e29-4632-b71c-00c7894b7228 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:10.761162 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-f2a27150-0e29-4632-b71c-00c7894b7228 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:13:10.761162 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:10.761162 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:10.761162 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:10.761162 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:10.761162 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:10.761162 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:10.761162 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:10.761162 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:10.761162 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:10.761162 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:10.761162 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:10.761162 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:13:10.761162 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:13:10.761162 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:13:10.762087 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:13:10.762087 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:10.762087 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:10.762087 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:10.762087 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:10.762087 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:10.762087 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:10.762087 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:10.762087 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:10.762087 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:10.762087 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:10.762087 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:10.762087 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:10.762087 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:10.762087 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:10.762087 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:10.762087 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:10.762957 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:13:10.762957 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:13:10.762957 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:13:10.762957 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:13:10.762957 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:13:10.762957 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:13:10.762957 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:13:10.762957 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:10.762957 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 320/637] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:13:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:13:10.768786 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b11c3-b44d-4a38-8e4b-20b367584318 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:10.873418 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b11c3-b44d-4a38-8e4b-20b367584318 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:10.908813 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938a376-67d1-4f24-a720-71ced21a6a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:10.909443 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938a376-67d1-4f24-a720-71ced21a6a8e None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:10.909727 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938a376-67d1-4f24-a720-71ced21a6a8e None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:10.910004 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938a376-67d1-4f24-a720-71ced21a6a8e None admin] PATH_INFO: `/v3/projects` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:10.910750 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938a376-67d1-4f24-a720-71ced21a6a8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:10.911059 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938a376-67d1-4f24-a720-71ced21a6a8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:10.912539 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938a376-67d1-4f24-a720-71ced21a6a8e None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:10.926338 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 318/638] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 16:13:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:10.932335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a27150-0e29-4632-b71c-00c7894b7228 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:11.043646 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a27150-0e29-4632-b71c-00c7894b7228 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:11.081093 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf268163-1e78-4961-829b-d55efb7a9dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:11.082158 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf268163-1e78-4961-829b-d55efb7a9dfd None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:11.082644 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf268163-1e78-4961-829b-d55efb7a9dfd None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:11.083120 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf268163-1e78-4961-829b-d55efb7a9dfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:11.084223 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf268163-1e78-4961-829b-d55efb7a9dfd None admin] RBAC: Adding query filter params (role.id=738aa511871f47acb7169da7e104be79, scope.project.id=73d63a3d7b724a5998ea2976430f242d, user.id=6a95bd511e264733bf7ea71b28ad96ab) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:11.084817 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf268163-1e78-4961-829b-d55efb7a9dfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:11.086538 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf268163-1e78-4961-829b-d55efb7a9dfd None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:11.096966 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 321/639] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 16:13:10 2022] GET /identity/v3/role_assignments?user.id=6a95bd511e264733bf7ea71b28ad96ab&scope.project.id=73d63a3d7b724a5998ea2976430f242d&role.id=738aa511871f47acb7169da7e104be79 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:11.676879 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437ac8d-4328-41bf-93fe-23abfcedb47b None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:11.677191 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437ac8d-4328-41bf-93fe-23abfcedb47b None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:11.677638 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437ac8d-4328-41bf-93fe-23abfcedb47b None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:11.680408 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 319/640] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:13:11.686139 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e56a4c-e537-4faa-b6ce-d3aaab6b04ce None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:11.686436 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e56a4c-e537-4faa-b6ce-d3aaab6b04ce None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:11.686721 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e56a4c-e537-4faa-b6ce-d3aaab6b04ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:11.730400 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-f1e56a4c-e537-4faa-b6ce-d3aaab6b04ce None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:11.731668 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-f1e56a4c-e537-4faa-b6ce-d3aaab6b04ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:11.787160 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:11.811504 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 322/641] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:13:11.831820 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437ac8d-4328-41bf-93fe-23abfcedb47b None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:11.863511 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:11.948355 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437ac8d-4328-41bf-93fe-23abfcedb47b None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:11.985558 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516fed4-bedd-4fbb-b732-dfeb1a5fc287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:11.986227 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516fed4-bedd-4fbb-b732-dfeb1a5fc287 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:11.986518 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516fed4-bedd-4fbb-b732-dfeb1a5fc287 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:11.986795 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516fed4-bedd-4fbb-b732-dfeb1a5fc287 None admin] PATH_INFO: `/v3/services/image` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:11.987453 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516fed4-bedd-4fbb-b732-dfeb1a5fc287 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:11.988843 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516fed4-bedd-4fbb-b732-dfeb1a5fc287 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:12.001164 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-4516fed4-bedd-4fbb-b732-dfeb1a5fc287 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 16:13:12.001164 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:12.001164 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:13:12.001164 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:13:12.001164 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:13:12.001164 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:13:12.001164 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:13:12.001164 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:12.001164 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 16:13:12.001164 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:12.001164 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:13:12.001164 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:12.001164 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:12.001164 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:12.001164 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:12.001164 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:12.001164 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:12.002416 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:12.002416 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:12.002416 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:12.002416 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:12.002416 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:12.002416 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:12.002416 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:13:12.002416 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:13:12.002416 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:13:12.002416 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:13:12.002416 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:12.002416 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:12.002416 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:12.002416 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:12.002416 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:12.002416 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:12.003507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:12.003507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:12.003507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:12.003507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:12.003507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:12.003507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:12.003507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:12.003507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:12.003507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:12.003507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:12.003507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:13:12.003507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:12.003507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 16:13:12.003507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:12.003507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 320/642] 10.222.0.65 () {56 vars in 1105 bytes} [Wed Jul 27 16:13:11 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:12.008697 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e56a4c-e537-4faa-b6ce-d3aaab6b04ce None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:12.144145 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e56a4c-e537-4faa-b6ce-d3aaab6b04ce None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:12.183065 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0233f-0596-44d9-b8fb-26db390180f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:12.184185 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0233f-0596-44d9-b8fb-26db390180f0 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:12.184692 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0233f-0596-44d9-b8fb-26db390180f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:12.185166 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0233f-0596-44d9-b8fb-26db390180f0 None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:12.186083 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0233f-0596-44d9-b8fb-26db390180f0 None admin] RBAC: Adding query filter params (name=image) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:12.186597 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0233f-0596-44d9-b8fb-26db390180f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:12.188808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0233f-0596-44d9-b8fb-26db390180f0 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:12.194567 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 323/643] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:13:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:12.200414 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516fed4-bedd-4fbb-b732-dfeb1a5fc287 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:12.247995 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab03f57-96cb-4101-8415-1a21de180cd2 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:12.248305 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab03f57-96cb-4101-8415-1a21de180cd2 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:12.248558 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab03f57-96cb-4101-8415-1a21de180cd2 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:12.250725 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 324/644] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:13:12.256210 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da6ad6-0f04-4a89-8aed-89311cd28323 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:12.256501 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da6ad6-0f04-4a89-8aed-89311cd28323 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:12.256786 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da6ad6-0f04-4a89-8aed-89311cd28323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:12.276377 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-84da6ad6-0f04-4a89-8aed-89311cd28323 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:12.277655 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-84da6ad6-0f04-4a89-8aed-89311cd28323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:12.309917 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:12.319704 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516fed4-bedd-4fbb-b732-dfeb1a5fc287 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:12.336787 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:12.360950 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ef7c5-96ee-45b1-a748-6b36c6b825b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:12.361914 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ef7c5-96ee-45b1-a748-6b36c6b825b5 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:12.362382 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ef7c5-96ee-45b1-a748-6b36c6b825b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:12.362839 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ef7c5-96ee-45b1-a748-6b36c6b825b5 None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:12.363747 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ef7c5-96ee-45b1-a748-6b36c6b825b5 None admin] RBAC: Adding query filter params (type=image) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:12.364316 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ef7c5-96ee-45b1-a748-6b36c6b825b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:12.366036 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ef7c5-96ee-45b1-a748-6b36c6b825b5 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:12.367624 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 325/645] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:13:12.379555 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 321/646] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:13:12 2022] GET /identity/v3/services?type=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:12.388365 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da6ad6-0f04-4a89-8aed-89311cd28323 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:12.511722 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da6ad6-0f04-4a89-8aed-89311cd28323 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:12.556679 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae42963-0d16-4e8f-8486-4aa94f9f5c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:12.557425 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae42963-0d16-4e8f-8486-4aa94f9f5c80 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:12.557707 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae42963-0d16-4e8f-8486-4aa94f9f5c80 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:12.557979 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae42963-0d16-4e8f-8486-4aa94f9f5c80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:12.571350 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae42963-0d16-4e8f-8486-4aa94f9f5c80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:13:12.576579 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-dae42963-0d16-4e8f-8486-4aa94f9f5c80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:13:12.576579 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:12.576579 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:12.576579 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:12.576579 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:12.576579 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:12.576579 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:12.576579 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:12.576579 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:12.576579 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:12.576579 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:12.576579 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:12.576579 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:13:12.576579 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:13:12.576579 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:13:12.576579 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:13:12.577610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:13:12.577610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:13:12.577610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:13:12.577610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:13:12.577610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:12.577610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:12.577610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:12.577610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:12.577610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:12.577610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:12.577610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:12.577610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:12.577610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:12.577610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:12.577610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:12.577610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:12.579032 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:12.579032 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:12.579032 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:12.579032 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:12.579032 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:13:12.579032 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:13:12.579032 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:13:12.579032 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:13:12.579032 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:13:12.579032 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:13:12.579032 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:13:12.579032 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:12.579032 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 326/647] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 16:13:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:12.583989 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ef7c5-96ee-45b1-a748-6b36c6b825b5 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:12.700212 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ef7c5-96ee-45b1-a748-6b36c6b825b5 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:12.739889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0382a24-b8b8-494b-b5ce-d9a1fe1479a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:12.740519 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0382a24-b8b8-494b-b5ce-d9a1fe1479a8 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:12.740805 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0382a24-b8b8-494b-b5ce-d9a1fe1479a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:12.741078 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0382a24-b8b8-494b-b5ce-d9a1fe1479a8 None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:12.741801 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0382a24-b8b8-494b-b5ce-d9a1fe1479a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:12.742106 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0382a24-b8b8-494b-b5ce-d9a1fe1479a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:12.743493 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0382a24-b8b8-494b-b5ce-d9a1fe1479a8 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:12.753477 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 322/648] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:13:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:12.758962 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae42963-0d16-4e8f-8486-4aa94f9f5c80 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:12.802057 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:12.865241 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21eaa79-d87b-4631-8d3e-1ac38c71efef None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:12.865530 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21eaa79-d87b-4631-8d3e-1ac38c71efef None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:12.865812 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21eaa79-d87b-4631-8d3e-1ac38c71efef None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:12.867614 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 323/649] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:13:12.869437 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae42963-0d16-4e8f-8486-4aa94f9f5c80 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:12.874955 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f884fd-db5e-4744-a2c1-e14383317372 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:12.875604 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f884fd-db5e-4744-a2c1-e14383317372 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:12.876109 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f884fd-db5e-4744-a2c1-e14383317372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:12.895499 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-b0f884fd-db5e-4744-a2c1-e14383317372 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:12.896970 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-b0f884fd-db5e-4744-a2c1-e14383317372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:12.907967 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbbd941-d123-48ff-936b-7de50d130650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:12.908882 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbbd941-d123-48ff-936b-7de50d130650 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:12.909312 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbbd941-d123-48ff-936b-7de50d130650 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:12.909754 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbbd941-d123-48ff-936b-7de50d130650 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:12.914020 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:12.925783 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbbd941-d123-48ff-936b-7de50d130650 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:12.927748 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbbd941-d123-48ff-936b-7de50d130650 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:12.945556 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-bfbbd941-d123-48ff-936b-7de50d130650 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:12.945556 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:12.945556 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:12.945556 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:12.945556 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:12.945556 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:12.945556 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:12.945556 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:12.945556 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:12.945556 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:12.945556 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:12.945556 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:12.945556 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:13:12.945556 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:13:12.945556 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:13:12.946682 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:13:12.946682 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:12.946682 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:12.946682 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:12.946682 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:12.946682 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:12.946682 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:12.946682 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:12.946682 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:12.946682 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:12.946682 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:12.946682 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:12.946682 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:12.946682 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:12.946682 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:12.946682 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:12.946682 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:12.947822 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:13:12.947822 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:13:12.947822 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:12.947822 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:12.949778 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 327/650] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:13:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:12.956764 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbbd941-d123-48ff-936b-7de50d130650 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:12.989992 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 324/651] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:13:13.013461 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f884fd-db5e-4744-a2c1-e14383317372 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:13.081541 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:13.092484 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbbd941-d123-48ff-936b-7de50d130650 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:13.130066 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78248786-e1ae-4079-8b93-cdaa56450ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:13.130747 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78248786-e1ae-4079-8b93-cdaa56450ff1 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:13.131030 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78248786-e1ae-4079-8b93-cdaa56450ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:13.131351 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78248786-e1ae-4079-8b93-cdaa56450ff1 None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:13.132767 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78248786-e1ae-4079-8b93-cdaa56450ff1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:13.133613 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78248786-e1ae-4079-8b93-cdaa56450ff1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:13.135704 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78248786-e1ae-4079-8b93-cdaa56450ff1 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:13.143862 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f884fd-db5e-4744-a2c1-e14383317372 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:13.149998 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 328/652] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:13.155134 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78248786-e1ae-4079-8b93-cdaa56450ff1 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:13.188429 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026dfe8-54a2-4c64-bcb8-76e66ca2e223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:13.189204 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026dfe8-54a2-4c64-bcb8-76e66ca2e223 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:13.189931 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026dfe8-54a2-4c64-bcb8-76e66ca2e223 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:13.190289 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026dfe8-54a2-4c64-bcb8-76e66ca2e223 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:13.191281 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026dfe8-54a2-4c64-bcb8-76e66ca2e223 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:13.193026 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026dfe8-54a2-4c64-bcb8-76e66ca2e223 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:13.205279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-3026dfe8-54a2-4c64-bcb8-76e66ca2e223 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 16:13:13.205279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:13.205279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:13:13.205279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:13:13.205279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:13:13.205279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:13:13.205279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:13:13.205279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:13.205279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 16:13:13.205279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:13.205279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:13:13.205279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:13.205279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:13.205279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:13.205279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:13.205279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:13.206310 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:13.206310 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:13.206310 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:13.206310 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:13.206310 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:13.206310 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:13.206310 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:13.206310 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:13:13.206310 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:13:13.206310 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:13:13.206310 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:13:13.206310 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:13.206310 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:13.206310 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:13.206310 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:13.206310 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:13.212281 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:13.212281 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:13.212281 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:13.212281 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:13.212281 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:13.212281 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:13.212281 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:13.212281 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:13.212281 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:13.212281 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:13.212281 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:13.212281 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:13:13.212281 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:13.212281 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 16:13:13.212281 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:13.212281 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 325/653] 10.222.0.65 () {56 vars in 1129 bytes} [Wed Jul 27 16:13:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:13:13.214892 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026dfe8-54a2-4c64-bcb8-76e66ca2e223 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:13.232460 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:13.295342 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78248786-e1ae-4079-8b93-cdaa56450ff1 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:13.336371 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5503e-cbb4-4c04-b61c-306af6f18bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:13.337422 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5503e-cbb4-4c04-b61c-306af6f18bab None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:13.337930 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5503e-cbb4-4c04-b61c-306af6f18bab None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:13.338404 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5503e-cbb4-4c04-b61c-306af6f18bab None admin] PATH_INFO: `/v3/users/nova` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:13.341251 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026dfe8-54a2-4c64-bcb8-76e66ca2e223 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:13.346812 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef5503e-cbb4-4c04-b61c-306af6f18bab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:13.348825 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef5503e-cbb4-4c04-b61c-306af6f18bab None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:13.362934 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-8ef5503e-cbb4-4c04-b61c-306af6f18bab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 16:13:13.362934 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:13.362934 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:13.362934 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:13.362934 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:13.362934 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:13.362934 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:13.362934 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:13.362934 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:13.362934 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:13.362934 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:13.362934 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:13.362934 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:13:13.362934 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:13:13.362934 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:13:13.362934 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:13:13.363974 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:13.363974 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:13.363974 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:13:13.363974 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:13:13.363974 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:13:13.363974 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:13:13.363974 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:13.363974 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:13.363974 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:13.363974 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:13.363974 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:13.363974 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:13.363974 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:13.363974 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:13.363974 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:13.363974 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:13.363974 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:13.363974 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:13.364977 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:13.364977 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:13.364977 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:13:13.364977 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:13:13.364977 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:13:13.364977 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:13:13.364977 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:13:13.364977 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:13:13.364977 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 16:13:13.364977 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:13.367640 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 329/654] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Jul 27 16:13:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:13.372902 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5503e-cbb4-4c04-b61c-306af6f18bab None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:13.388358 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:13.389027 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a869e9-4ad9-4a69-b424-2f35d17c5f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:13.390807 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a869e9-4ad9-4a69-b424-2f35d17c5f9f None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:13.391602 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a869e9-4ad9-4a69-b424-2f35d17c5f9f None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:13.392060 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a869e9-4ad9-4a69-b424-2f35d17c5f9f None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:13.392965 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a869e9-4ad9-4a69-b424-2f35d17c5f9f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:13.393494 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a869e9-4ad9-4a69-b424-2f35d17c5f9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:13.395111 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a869e9-4ad9-4a69-b424-2f35d17c5f9f None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:13.402195 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 326/655] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Jul 27 16:13:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:13:13.409000 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a869e9-4ad9-4a69-b424-2f35d17c5f9f None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:13.502939 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:13.521809 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5503e-cbb4-4c04-b61c-306af6f18bab None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:13.538205 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a869e9-4ad9-4a69-b424-2f35d17c5f9f None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:13.564038 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429ee8c-0a2f-44c8-9b9c-84d36177e0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:13.564673 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429ee8c-0a2f-44c8-9b9c-84d36177e0fa None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:13.564970 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429ee8c-0a2f-44c8-9b9c-84d36177e0fa None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:13.565251 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429ee8c-0a2f-44c8-9b9c-84d36177e0fa None admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:13.566421 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429ee8c-0a2f-44c8-9b9c-84d36177e0fa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:13.566421 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429ee8c-0a2f-44c8-9b9c-84d36177e0fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:13.567886 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429ee8c-0a2f-44c8-9b9c-84d36177e0fa None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:13.583817 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5f3dd-92a2-44ae-875e-7e7202141151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:13.584445 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5f3dd-92a2-44ae-875e-7e7202141151 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:13.584725 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5f3dd-92a2-44ae-875e-7e7202141151 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:13.584999 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5f3dd-92a2-44ae-875e-7e7202141151 None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:13.585666 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5f3dd-92a2-44ae-875e-7e7202141151 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:13.585971 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5f3dd-92a2-44ae-875e-7e7202141151 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:13.587407 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5f3dd-92a2-44ae-875e-7e7202141151 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:13.588690 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 330/656] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Jul 27 16:13:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:13.590032 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe62a8-d661-405f-8cc1-cf544a9e2dcf None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:13.590328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe62a8-d661-405f-8cc1-cf544a9e2dcf None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:13.590610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe62a8-d661-405f-8cc1-cf544a9e2dcf None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:13.591994 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 331/657] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:13:13.596468 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe62a8-d661-405f-8cc1-cf544a9e2dcf None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:13.598184 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 327/658] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Jul 27 16:13:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:13:13.598376 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d292e8-7de5-428c-9307-6086c1801277 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:13.602052 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d292e8-7de5-428c-9307-6086c1801277 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:13.602052 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d292e8-7de5-428c-9307-6086c1801277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:13.618678 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-f7d292e8-7de5-428c-9307-6086c1801277 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:13.619944 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-f7d292e8-7de5-428c-9307-6086c1801277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:13.684557 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:13.720615 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 328/659] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:13:13.730262 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe62a8-d661-405f-8cc1-cf544a9e2dcf None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:13.744239 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d292e8-7de5-428c-9307-6086c1801277 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:13.773783 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a01311-4a48-4b25-a030-2e556019ace7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:13.774440 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a01311-4a48-4b25-a030-2e556019ace7 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:13.774732 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a01311-4a48-4b25-a030-2e556019ace7 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:13.775083 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a01311-4a48-4b25-a030-2e556019ace7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:13.849571 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:13.875171 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a01311-4a48-4b25-a030-2e556019ace7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:13.876692 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a01311-4a48-4b25-a030-2e556019ace7 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:13.894129 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d292e8-7de5-428c-9307-6086c1801277 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:13.942972 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f571e-3304-4ac4-aecc-90d8d04c633e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:13.943759 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f571e-3304-4ac4-aecc-90d8d04c633e None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:13.944116 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f571e-3304-4ac4-aecc-90d8d04c633e None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:13.944464 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f571e-3304-4ac4-aecc-90d8d04c633e None admin] PATH_INFO: `/v3/services/network` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:13.945712 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f571e-3304-4ac4-aecc-90d8d04c633e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:13.947440 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f571e-3304-4ac4-aecc-90d8d04c633e None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:13.961013 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:13.962332 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-646f571e-3304-4ac4-aecc-90d8d04c633e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 16:13:13.962332 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:13.962332 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:13:13.962332 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:13:13.962332 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:13:13.962332 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:13:13.962332 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:13:13.962332 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:13.962332 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 16:13:13.962332 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:13.962332 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:13:13.962332 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:13.962332 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:13.962332 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:13.962332 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:13.962332 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:13.962332 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:13.963560 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:13.963560 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:13.963560 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:13.963560 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:13.963560 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:13.963560 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:13.963560 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:13:13.963560 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:13:13.963560 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:13:13.963560 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:13:13.963560 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:13.963560 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:13.963560 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:13.963560 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:13.963560 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:13.963560 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:13.964515 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:13.964515 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:13.964515 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:13.964515 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:13.964515 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:13.964515 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:13.964515 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:13.964515 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:13.964515 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:13.964515 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:13.964515 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:13:13.964515 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:13.964515 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 16:13:13.964515 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:13.969988 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 329/660] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:13:13 2022] GET /identity/v3/services/network => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:13:13.971320 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f571e-3304-4ac4-aecc-90d8d04c633e None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:14.010737 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 332/661] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:13:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:13:14.015918 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a01311-4a48-4b25-a030-2e556019ace7 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:14.091564 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f571e-3304-4ac4-aecc-90d8d04c633e None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:14.122004 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a01311-4a48-4b25-a030-2e556019ace7 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:14.132795 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fac29-9feb-48a1-87a6-f22ba8dff4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:14.133654 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fac29-9feb-48a1-87a6-f22ba8dff4e8 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:14.134210 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fac29-9feb-48a1-87a6-f22ba8dff4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:14.134616 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fac29-9feb-48a1-87a6-f22ba8dff4e8 None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:14.135562 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fac29-9feb-48a1-87a6-f22ba8dff4e8 None admin] RBAC: Adding query filter params (name=network) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:14.136060 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fac29-9feb-48a1-87a6-f22ba8dff4e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:14.137637 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fac29-9feb-48a1-87a6-f22ba8dff4e8 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:14.139157 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:14.146774 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 330/662] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 16:13:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:13:14.152372 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fac29-9feb-48a1-87a6-f22ba8dff4e8 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:14.166554 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca3a57-e9cc-4acc-94f2-5510fd16f93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:14.167388 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca3a57-e9cc-4acc-94f2-5510fd16f93b None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:14.167974 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca3a57-e9cc-4acc-94f2-5510fd16f93b None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:14.168126 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca3a57-e9cc-4acc-94f2-5510fd16f93b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:14.178950 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca3a57-e9cc-4acc-94f2-5510fd16f93b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:14.180582 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca3a57-e9cc-4acc-94f2-5510fd16f93b None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:14.196216 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-5fca3a57-e9cc-4acc-94f2-5510fd16f93b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:14.196216 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:14.196216 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:14.196216 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:14.196216 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:14.196216 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:14.196216 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:14.196216 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:14.196216 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:14.196216 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:14.196216 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:14.196216 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:14.196216 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:13:14.196216 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:13:14.196216 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:13:14.197236 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:13:14.197236 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:14.197236 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:14.197236 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:14.197236 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:14.197236 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:14.197236 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:14.197236 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:14.197236 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:14.197236 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:14.197236 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:14.197236 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:14.197236 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:14.197236 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:14.197236 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:14.197236 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:14.197236 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:14.198114 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:13:14.198114 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:13:14.198114 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:14.198114 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:14.203191 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 333/663] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:13:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:13:14.204458 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca3a57-e9cc-4acc-94f2-5510fd16f93b None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:14.227776 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:14.268846 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fac29-9feb-48a1-87a6-f22ba8dff4e8 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:14.307211 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a85b7-36ff-4902-95c0-c09d2954eb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:14.308413 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a85b7-36ff-4902-95c0-c09d2954eb7f None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:14.308900 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a85b7-36ff-4902-95c0-c09d2954eb7f None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:14.309342 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a85b7-36ff-4902-95c0-c09d2954eb7f None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:14.310189 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a85b7-36ff-4902-95c0-c09d2954eb7f None admin] RBAC: Adding query filter params (type=network) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:14.310667 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a85b7-36ff-4902-95c0-c09d2954eb7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:14.311526 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca3a57-e9cc-4acc-94f2-5510fd16f93b None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:14.313006 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a85b7-36ff-4902-95c0-c09d2954eb7f None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:14.318724 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 331/664] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 16:13:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:14.352281 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be1d90-90ff-46c1-bc59-cff035e1d323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:14.352930 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be1d90-90ff-46c1-bc59-cff035e1d323 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:14.353216 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be1d90-90ff-46c1-bc59-cff035e1d323 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:14.353498 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be1d90-90ff-46c1-bc59-cff035e1d323 None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:14.354217 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be1d90-90ff-46c1-bc59-cff035e1d323 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:14.354529 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be1d90-90ff-46c1-bc59-cff035e1d323 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:14.355996 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be1d90-90ff-46c1-bc59-cff035e1d323 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:14.369873 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 334/665] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:14.376575 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a85b7-36ff-4902-95c0-c09d2954eb7f None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:14.461251 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:14.504815 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a85b7-36ff-4902-95c0-c09d2954eb7f None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:14.542377 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a1063-eec1-4628-b9d6-f95fee95c37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:14.543020 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a1063-eec1-4628-b9d6-f95fee95c37b None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:14.543303 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a1063-eec1-4628-b9d6-f95fee95c37b None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:14.543605 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a1063-eec1-4628-b9d6-f95fee95c37b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:14.550505 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441a1063-eec1-4628-b9d6-f95fee95c37b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:14.552068 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441a1063-eec1-4628-b9d6-f95fee95c37b None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:14.564812 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-441a1063-eec1-4628-b9d6-f95fee95c37b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:13:14.564812 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:14.564812 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:14.564812 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:14.564812 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:14.564812 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:14.564812 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:14.564812 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:14.564812 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:14.564812 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:14.564812 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:14.564812 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:14.564812 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:13:14.564812 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:13:14.564812 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:13:14.565752 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:13:14.565752 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:14.565752 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:14.565752 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:14.565752 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:14.565752 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:14.565752 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:14.565752 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:14.565752 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:14.565752 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:14.565752 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:14.565752 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:14.565752 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:14.565752 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:14.565752 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:14.565752 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:14.565752 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:14.566838 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:13:14.566838 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:13:14.566838 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:13:14.566838 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:13:14.566838 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:13:14.566838 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:13:14.566838 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:13:14.566838 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:14.566838 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 332/666] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:13:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:14.571971 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be1d90-90ff-46c1-bc59-cff035e1d323 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:14.658744 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:14.680745 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be1d90-90ff-46c1-bc59-cff035e1d323 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:14.724950 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb33e44-93ec-427c-9148-1a01b334401e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:14.725586 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb33e44-93ec-427c-9148-1a01b334401e None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:14.725874 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb33e44-93ec-427c-9148-1a01b334401e None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:14.726158 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb33e44-93ec-427c-9148-1a01b334401e None admin] PATH_INFO: `/v3/projects` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:14.726912 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb33e44-93ec-427c-9148-1a01b334401e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:14.727226 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb33e44-93ec-427c-9148-1a01b334401e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:14.728717 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb33e44-93ec-427c-9148-1a01b334401e None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:14.741997 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 335/667] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 16:13:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:14.750161 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a1063-eec1-4628-b9d6-f95fee95c37b None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:14.861881 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a1063-eec1-4628-b9d6-f95fee95c37b None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:14.886571 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc261b83-f0ac-4f61-966b-3539e5639920 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:14.887060 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc261b83-f0ac-4f61-966b-3539e5639920 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:14.887576 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc261b83-f0ac-4f61-966b-3539e5639920 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:14.896770 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 336/668] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:13:14.898964 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74e652-7d9e-42df-9017-f65ec56690e5 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:14.899521 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74e652-7d9e-42df-9017-f65ec56690e5 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:14.900011 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74e652-7d9e-42df-9017-f65ec56690e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:14.902678 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:14.907319 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26582283-4700-44db-9cb3-dd10679c5b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:14.908271 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26582283-4700-44db-9cb3-dd10679c5b90 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:14.908842 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26582283-4700-44db-9cb3-dd10679c5b90 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:14.909395 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26582283-4700-44db-9cb3-dd10679c5b90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:14.910434 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26582283-4700-44db-9cb3-dd10679c5b90 None admin] RBAC: Adding query filter params (role.id=76e01abae9964dd5b28fc8895f739ee4, scope.project.id=73d63a3d7b724a5998ea2976430f242d, user.id=66768f9443c046b3bd75853a4b2b980e) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:14.910950 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26582283-4700-44db-9cb3-dd10679c5b90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:14.912674 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26582283-4700-44db-9cb3-dd10679c5b90 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:14.919560 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 333/669] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 16:13:14 2022] GET /identity/v3/role_assignments?user.id=66768f9443c046b3bd75853a4b2b980e&scope.project.id=73d63a3d7b724a5998ea2976430f242d&role.id=76e01abae9964dd5b28fc8895f739ee4 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:13:14.933054 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-8c74e652-7d9e-42df-9017-f65ec56690e5 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:14.934620 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-8c74e652-7d9e-42df-9017-f65ec56690e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:15.010604 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 337/670] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:13:15.035314 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26582283-4700-44db-9cb3-dd10679c5b90 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:15.156076 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26582283-4700-44db-9cb3-dd10679c5b90 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:15.192076 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df806a0-7259-4318-9518-2b83ac503823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:15.192628 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df806a0-7259-4318-9518-2b83ac503823 None admin] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:15.192958 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df806a0-7259-4318-9518-2b83ac503823 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:15.193244 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df806a0-7259-4318-9518-2b83ac503823 None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:15.193965 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df806a0-7259-4318-9518-2b83ac503823 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:15.195336 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df806a0-7259-4318-9518-2b83ac503823 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:15.215355 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 334/671] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 16:13:15 2022] POST /identity/v3/services => generated 242 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:13:16.032976 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e48e8f-053e-46d1-8361-9389b98703a2 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:16.033471 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e48e8f-053e-46d1-8361-9389b98703a2 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:16.033471 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e48e8f-053e-46d1-8361-9389b98703a2 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:16.035037 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 338/672] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:13:16.040469 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036d110-6864-4e10-8955-70f6496447be None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:16.040758 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036d110-6864-4e10-8955-70f6496447be None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:16.041041 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036d110-6864-4e10-8955-70f6496447be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:16.060208 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-f036d110-6864-4e10-8955-70f6496447be None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:16.061457 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-f036d110-6864-4e10-8955-70f6496447be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:16.106521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:16.150083 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 335/673] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:16 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:13:16.175486 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e48e8f-053e-46d1-8361-9389b98703a2 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:16.251889 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:16.285510 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e48e8f-053e-46d1-8361-9389b98703a2 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:16.321767 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d542f-459c-4dd8-a3f4-5d720cbd7035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:16.322461 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d542f-459c-4dd8-a3f4-5d720cbd7035 None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:16.322749 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d542f-459c-4dd8-a3f4-5d720cbd7035 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:16.323066 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d542f-459c-4dd8-a3f4-5d720cbd7035 None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:16.323818 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d542f-459c-4dd8-a3f4-5d720cbd7035 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:16.325271 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d542f-459c-4dd8-a3f4-5d720cbd7035 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:16.344829 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 339/674] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 16:13:16 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:13:16.735779 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6defc3c-561a-4592-b1e1-12f4f9a2e532 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:16.736328 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6defc3c-561a-4592-b1e1-12f4f9a2e532 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:16.736577 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6defc3c-561a-4592-b1e1-12f4f9a2e532 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:16.738295 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 336/675] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:13:16.743868 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c196bc2-1495-4c2e-880c-e8d815d47865 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:16.744272 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c196bc2-1495-4c2e-880c-e8d815d47865 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:16.744653 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c196bc2-1495-4c2e-880c-e8d815d47865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:16.763017 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-1c196bc2-1495-4c2e-880c-e8d815d47865 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:16.764220 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-1c196bc2-1495-4c2e-880c-e8d815d47865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:16.841368 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 340/676] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:16 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:13:16.864890 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6defc3c-561a-4592-b1e1-12f4f9a2e532 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:16.976843 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6defc3c-561a-4592-b1e1-12f4f9a2e532 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:17.011659 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd6482-4d51-4899-88ff-ec7c8a1e6221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:17.012698 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd6482-4d51-4899-88ff-ec7c8a1e6221 None admin] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:17.013179 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd6482-4d51-4899-88ff-ec7c8a1e6221 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:17.013860 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd6482-4d51-4899-88ff-ec7c8a1e6221 None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:17.014754 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd6482-4d51-4899-88ff-ec7c8a1e6221 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:17.016875 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd6482-4d51-4899-88ff-ec7c8a1e6221 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:17.035005 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 337/677] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 16:13:16 2022] POST /identity/v3/services => generated 240 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:13:17.304706 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b20e3-84a9-4f09-8b0b-b076fc21e6be None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:17.305729 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b20e3-84a9-4f09-8b0b-b076fc21e6be None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:17.306269 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b20e3-84a9-4f09-8b0b-b076fc21e6be None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:17.308449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 341/678] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:13:17.315690 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911eb416-664e-4239-9e04-e02cfdce34b4 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:17.316269 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911eb416-664e-4239-9e04-e02cfdce34b4 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:17.316741 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911eb416-664e-4239-9e04-e02cfdce34b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:17.336100 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-911eb416-664e-4239-9e04-e02cfdce34b4 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:17.337583 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-911eb416-664e-4239-9e04-e02cfdce34b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:17.364563 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:17.422531 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 338/679] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:17 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 16:13:17.447191 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b20e3-84a9-4f09-8b0b-b076fc21e6be None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:17.507693 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:17.551103 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aca1b0-9013-4bb4-b4a9-7317bc136c50 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:17.551435 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aca1b0-9013-4bb4-b4a9-7317bc136c50 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:17.551687 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aca1b0-9013-4bb4-b4a9-7317bc136c50 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:17.553354 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 339/680] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:13:17.560221 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71f3fc-43de-4e35-ba3e-06e606aad0a7 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:17.560374 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b20e3-84a9-4f09-8b0b-b076fc21e6be None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:17.560467 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71f3fc-43de-4e35-ba3e-06e606aad0a7 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:17.560716 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71f3fc-43de-4e35-ba3e-06e606aad0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:17.586444 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-1e71f3fc-43de-4e35-ba3e-06e606aad0a7 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:17.587651 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-1e71f3fc-43de-4e35-ba3e-06e606aad0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:17.608414 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ed880-d5d8-4636-80ae-b9e4d4c05a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:17.610513 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ed880-d5d8-4636-80ae-b9e4d4c05a5d None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:17.611228 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ed880-d5d8-4636-80ae-b9e4d4c05a5d None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:17.611983 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ed880-d5d8-4636-80ae-b9e4d4c05a5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:17.625064 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ed880-d5d8-4636-80ae-b9e4d4c05a5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:13:17.631273 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-568ed880-d5d8-4636-80ae-b9e4d4c05a5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:13:17.631273 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:17.631273 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:17.631273 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:17.631273 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:17.631273 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:17.631273 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:17.631273 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:17.631273 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:17.631273 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:17.631273 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:17.631273 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:17.631273 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:13:17.631273 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:13:17.631273 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:13:17.631273 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:13:17.632515 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:13:17.632515 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:13:17.632515 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:13:17.632515 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:13:17.632515 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:17.632515 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:17.632515 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:17.632515 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:17.632515 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:17.632515 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:17.632515 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:17.632515 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:17.632515 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:17.632515 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:17.632515 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:17.632515 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:17.633357 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:17.633357 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:17.633357 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:17.633357 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:17.633357 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:13:17.633357 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:13:17.633357 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:13:17.633357 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:13:17.633357 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:13:17.633357 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:13:17.633357 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:13:17.633357 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:17.636239 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 342/681] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 16:13:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:17.644772 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ed880-d5d8-4636-80ae-b9e4d4c05a5d None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:17.689495 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 340/682] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:17 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:13:17.713243 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71f3fc-43de-4e35-ba3e-06e606aad0a7 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:17.752812 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ed880-d5d8-4636-80ae-b9e4d4c05a5d None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:17.770591 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:17.789903 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2413954-f682-45f7-bbeb-a4e69c9dda26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:17.790529 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2413954-f682-45f7-bbeb-a4e69c9dda26 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:17.790811 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2413954-f682-45f7-bbeb-a4e69c9dda26 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:17.791084 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2413954-f682-45f7-bbeb-a4e69c9dda26 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:17.791893 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2413954-f682-45f7-bbeb-a4e69c9dda26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:17.792148 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2413954-f682-45f7-bbeb-a4e69c9dda26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:17.793567 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2413954-f682-45f7-bbeb-a4e69c9dda26 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:17.805981 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 343/683] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:13:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:13:17.811397 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2413954-f682-45f7-bbeb-a4e69c9dda26 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:17.830227 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:17.848721 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71f3fc-43de-4e35-ba3e-06e606aad0a7 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:17.896910 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d84d8-96f3-4e88-82a4-ec47b57c5310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:17.897922 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d84d8-96f3-4e88-82a4-ec47b57c5310 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:17.898411 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d84d8-96f3-4e88-82a4-ec47b57c5310 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:17.899464 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d84d8-96f3-4e88-82a4-ec47b57c5310 None admin] PATH_INFO: `/v3/services/image` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:17.900325 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d84d8-96f3-4e88-82a4-ec47b57c5310 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:17.902786 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d84d8-96f3-4e88-82a4-ec47b57c5310 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:17.915863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-b90d84d8-96f3-4e88-82a4-ec47b57c5310 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 16:13:17.915863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:17.915863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:13:17.915863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:13:17.915863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:13:17.915863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:13:17.915863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:13:17.915863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:17.915863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 16:13:17.915863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:17.915863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:13:17.915863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:17.915863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:17.915863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:17.915863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:17.915863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:17.915863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:17.916899 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:17.916899 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:17.916899 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:17.916899 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:17.916899 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:17.916899 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:17.916899 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:13:17.916899 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:13:17.916899 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:13:17.916899 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:13:17.916899 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:17.916899 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:17.916899 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:17.916899 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:17.916899 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:17.916899 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:17.917756 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:17.917756 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:17.917756 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:17.917756 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:17.917756 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:17.917756 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:17.917756 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:17.917756 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:17.917756 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:17.917756 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:17.917756 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:13:17.917756 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:17.917756 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 16:13:17.917756 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:17.921541 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 341/684] 10.222.0.65 () {56 vars in 1105 bytes} [Wed Jul 27 16:13:17 2022] GET /identity/v3/services/image => generated 86 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:17.929417 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d84d8-96f3-4e88-82a4-ec47b57c5310 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:17.935171 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2413954-f682-45f7-bbeb-a4e69c9dda26 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:17.978145 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c186690-2cb6-4f42-bff9-052625fd2f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:17.978816 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c186690-2cb6-4f42-bff9-052625fd2f40 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:17.979106 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c186690-2cb6-4f42-bff9-052625fd2f40 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:17.979413 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c186690-2cb6-4f42-bff9-052625fd2f40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:17.992824 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c186690-2cb6-4f42-bff9-052625fd2f40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:17.994751 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c186690-2cb6-4f42-bff9-052625fd2f40 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:18.012380 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-6c186690-2cb6-4f42-bff9-052625fd2f40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:18.012380 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:18.012380 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:18.012380 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:18.012380 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:18.012380 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:18.012380 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:18.012380 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:18.012380 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:18.012380 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:18.012380 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:18.012380 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:18.012380 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:13:18.012380 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:13:18.012380 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:13:18.013348 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:13:18.013348 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:18.013348 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:18.013348 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:18.013348 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:18.013348 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:18.013348 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:18.013348 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:18.013348 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:18.013348 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:18.013348 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:18.013348 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:18.013348 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:18.013348 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:18.013348 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:18.013348 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:18.013348 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:18.014236 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:13:18.014236 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:13:18.014236 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:18.014236 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:18.014236 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 344/685] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:13:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:18.019584 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c186690-2cb6-4f42-bff9-052625fd2f40 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:18.041881 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d84d8-96f3-4e88-82a4-ec47b57c5310 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:18.060700 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:18.091487 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf73ff-dd5f-481f-9433-4c3a2841e01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:18.091487 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf73ff-dd5f-481f-9433-4c3a2841e01a None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:18.091487 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf73ff-dd5f-481f-9433-4c3a2841e01a None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:18.091487 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf73ff-dd5f-481f-9433-4c3a2841e01a None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:18.091910 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf73ff-dd5f-481f-9433-4c3a2841e01a None admin] RBAC: Adding query filter params (name=image) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:18.091910 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf73ff-dd5f-481f-9433-4c3a2841e01a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:18.091910 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf73ff-dd5f-481f-9433-4c3a2841e01a None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:18.096531 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 342/686] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:13:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:18.101850 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf73ff-dd5f-481f-9433-4c3a2841e01a None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:18.125439 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:18.164579 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c186690-2cb6-4f42-bff9-052625fd2f40 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:18.218232 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d44546-3c06-4128-a317-93e17e234b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:18.219398 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d44546-3c06-4128-a317-93e17e234b64 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:18.219682 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d44546-3c06-4128-a317-93e17e234b64 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:18.219961 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d44546-3c06-4128-a317-93e17e234b64 None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:18.220670 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d44546-3c06-4128-a317-93e17e234b64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:18.220980 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d44546-3c06-4128-a317-93e17e234b64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:18.222387 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d44546-3c06-4128-a317-93e17e234b64 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:18.236953 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 345/687] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:13:18.242260 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d44546-3c06-4128-a317-93e17e234b64 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:18.259794 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf73ff-dd5f-481f-9433-4c3a2841e01a None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:18.308940 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4ada3-2bc4-4727-b878-aebcfcc99963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:18.310376 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4ada3-2bc4-4727-b878-aebcfcc99963 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:18.310809 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4ada3-2bc4-4727-b878-aebcfcc99963 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:18.311734 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4ada3-2bc4-4727-b878-aebcfcc99963 None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:18.313191 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4ada3-2bc4-4727-b878-aebcfcc99963 None admin] RBAC: Adding query filter params (type=image) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:18.313504 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4ada3-2bc4-4727-b878-aebcfcc99963 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:18.314871 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4ada3-2bc4-4727-b878-aebcfcc99963 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:18.325043 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 343/688] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:13:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:13:18.325928 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4ada3-2bc4-4727-b878-aebcfcc99963 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:18.351731 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:18.367482 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d44546-3c06-4128-a317-93e17e234b64 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:18.406549 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835bbb08-0713-4fbf-9b0e-1ae5297937aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:18.407690 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bbb08-0713-4fbf-9b0e-1ae5297937aa None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:18.408043 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bbb08-0713-4fbf-9b0e-1ae5297937aa None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:18.408407 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bbb08-0713-4fbf-9b0e-1ae5297937aa None admin] PATH_INFO: `/v3/users/nova` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:18.418916 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835bbb08-0713-4fbf-9b0e-1ae5297937aa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:18.420167 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835bbb08-0713-4fbf-9b0e-1ae5297937aa None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:18.427780 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:18.434394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-835bbb08-0713-4fbf-9b0e-1ae5297937aa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 16:13:18.434394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:18.434394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:18.434394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:18.434394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:18.434394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:18.434394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:18.434394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:18.434394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:18.434394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:18.434394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:18.434394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:18.434394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:13:18.434394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:13:18.434394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:13:18.434394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:13:18.435829 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:18.435829 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:18.435829 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:13:18.435829 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:13:18.435829 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:13:18.435829 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:13:18.435829 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:18.435829 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:18.435829 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:18.435829 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:18.435829 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:18.435829 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:18.435829 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:18.435829 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:18.435829 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:18.435829 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:18.435829 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:18.435829 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:18.436903 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:18.436903 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:18.436903 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:13:18.436903 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:13:18.436903 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:13:18.436903 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:13:18.436903 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:13:18.436903 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:13:18.436903 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 16:13:18.436903 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:18.441303 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 346/689] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Jul 27 16:13:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:18.442332 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835bbb08-0713-4fbf-9b0e-1ae5297937aa None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:18.456700 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4ada3-2bc4-4727-b878-aebcfcc99963 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:18.511087 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c4e5d-7071-417d-8164-f509c49cf474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:18.512605 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c4e5d-7071-417d-8164-f509c49cf474 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:18.513162 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c4e5d-7071-417d-8164-f509c49cf474 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:18.513622 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c4e5d-7071-417d-8164-f509c49cf474 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:18.514760 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c4e5d-7071-417d-8164-f509c49cf474 None admin] RBAC: Adding query filter params (interface=public, service_id=cb0f63bf471f4579b8d6d889a5a59195, region_id=RegionOne) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:18.515672 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c4e5d-7071-417d-8164-f509c49cf474 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:18.517803 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c4e5d-7071-417d-8164-f509c49cf474 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:18.529070 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 344/690] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Jul 27 16:13:18 2022] GET /identity/v3/endpoints?service_id=cb0f63bf471f4579b8d6d889a5a59195&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:18.534680 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c4e5d-7071-417d-8164-f509c49cf474 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:18.567620 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835bbb08-0713-4fbf-9b0e-1ae5297937aa None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:18.612153 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c64531-33a1-420a-8d52-38b4a894ad88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:18.612694 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c64531-33a1-420a-8d52-38b4a894ad88 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:18.612976 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c64531-33a1-420a-8d52-38b4a894ad88 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:18.613250 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c64531-33a1-420a-8d52-38b4a894ad88 None admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:18.615075 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c64531-33a1-420a-8d52-38b4a894ad88 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:18.615429 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c64531-33a1-420a-8d52-38b4a894ad88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:18.616905 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c64531-33a1-420a-8d52-38b4a894ad88 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:18.637321 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 347/691] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Jul 27 16:13:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:18.642942 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c64531-33a1-420a-8d52-38b4a894ad88 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:18.658377 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:18.662173 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c4e5d-7071-417d-8164-f509c49cf474 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:18.716274 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57b0c3-f3b4-4f4d-a34f-9a3beab6bb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:18.716997 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57b0c3-f3b4-4f4d-a34f-9a3beab6bb6d None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:18.717286 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57b0c3-f3b4-4f4d-a34f-9a3beab6bb6d None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:18.717659 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57b0c3-f3b4-4f4d-a34f-9a3beab6bb6d None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:18.718500 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db57b0c3-f3b4-4f4d-a34f-9a3beab6bb6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:18.720236 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db57b0c3-f3b4-4f4d-a34f-9a3beab6bb6d None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:18.735052 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 345/692] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Jul 27 16:13:18 2022] GET /identity/v3/services => generated 1002 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:13:18.791824 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c64531-33a1-420a-8d52-38b4a894ad88 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:18.800289 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ca17a-8581-48ee-a05c-dbf03c02e6a8 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:18.800574 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ca17a-8581-48ee-a05c-dbf03c02e6a8 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:18.800862 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ca17a-8581-48ee-a05c-dbf03c02e6a8 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:18.802534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 346/693] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:13:18.808106 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46475629-47d7-45c3-a923-d5790ef35441 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:18.808460 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46475629-47d7-45c3-a923-d5790ef35441 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:18.808676 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46475629-47d7-45c3-a923-d5790ef35441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:18.828215 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-46475629-47d7-45c3-a923-d5790ef35441 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:18.829454 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-46475629-47d7-45c3-a923-d5790ef35441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:18.832021 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:18.837554 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429df67-2adf-4c46-9b4b-479ad120491e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:18.838616 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429df67-2adf-4c46-9b4b-479ad120491e None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:18.839759 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429df67-2adf-4c46-9b4b-479ad120491e None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:18.840316 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429df67-2adf-4c46-9b4b-479ad120491e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:18.855876 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429df67-2adf-4c46-9b4b-479ad120491e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:18.858247 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429df67-2adf-4c46-9b4b-479ad120491e None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:18.879761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-a429df67-2adf-4c46-9b4b-479ad120491e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:18.879761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:18.879761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:18.879761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:18.879761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:18.879761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:18.879761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:18.879761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:18.879761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:18.879761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:18.879761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:18.879761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:18.879761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:13:18.879761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:13:18.879761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:13:18.880685 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:13:18.880685 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:18.880685 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:18.880685 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:18.880685 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:18.880685 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:18.880685 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:18.880685 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:18.880685 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:18.880685 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:18.880685 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:18.880685 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:18.880685 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:18.880685 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:18.880685 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:18.880685 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:18.880685 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:18.881661 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:13:18.881661 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:13:18.881661 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:18.881661 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:18.881661 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 348/694] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:13:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:13:18.886472 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429df67-2adf-4c46-9b4b-479ad120491e None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:18.926516 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 347/695] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:18 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 16:13:18.949018 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46475629-47d7-45c3-a923-d5790ef35441 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:18.974003 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:19.027870 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429df67-2adf-4c46-9b4b-479ad120491e None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:19.063658 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd5d49-be53-4f69-8d43-e4faf333852d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:19.064284 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd5d49-be53-4f69-8d43-e4faf333852d None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:19.064566 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd5d49-be53-4f69-8d43-e4faf333852d None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:19.064842 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd5d49-be53-4f69-8d43-e4faf333852d None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:19.065531 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd5d49-be53-4f69-8d43-e4faf333852d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:19.065835 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd5d49-be53-4f69-8d43-e4faf333852d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:19.067584 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd5d49-be53-4f69-8d43-e4faf333852d None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:19.080153 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 349/696] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:19.083025 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46475629-47d7-45c3-a923-d5790ef35441 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:19.085761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd5d49-be53-4f69-8d43-e4faf333852d None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:19.126380 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce861b1-40d6-4d42-9f0d-54a177ac85eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:19.127434 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce861b1-40d6-4d42-9f0d-54a177ac85eb None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:19.127924 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce861b1-40d6-4d42-9f0d-54a177ac85eb None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:19.128398 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce861b1-40d6-4d42-9f0d-54a177ac85eb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:19.129258 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce861b1-40d6-4d42-9f0d-54a177ac85eb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:19.130887 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce861b1-40d6-4d42-9f0d-54a177ac85eb None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:19.141003 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-fce861b1-40d6-4d42-9f0d-54a177ac85eb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 16:13:19.141003 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:19.141003 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:13:19.141003 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:13:19.141003 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:13:19.141003 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:13:19.141003 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:13:19.141003 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:19.141003 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 16:13:19.141003 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:19.141003 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:13:19.141003 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:19.141003 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:19.141003 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:19.141003 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:19.141003 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:19.141975 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:19.141975 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:19.141975 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:19.141975 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:19.141975 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:19.141975 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:19.141975 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:19.141975 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:13:19.141975 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:13:19.141975 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:13:19.141975 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:13:19.141975 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:19.141975 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:19.141975 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:19.141975 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:19.141975 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:19.142825 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:19.142825 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:19.142825 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:19.142825 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:19.142825 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:19.142825 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:19.142825 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:19.142825 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:19.142825 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:19.142825 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:19.142825 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:19.142825 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:13:19.142825 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:19.142825 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 16:13:19.142825 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:19.145810 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 348/697] 10.222.0.65 () {56 vars in 1129 bytes} [Wed Jul 27 16:13:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:13:19.151325 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce861b1-40d6-4d42-9f0d-54a177ac85eb None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:19.154623 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:19.204962 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd5d49-be53-4f69-8d43-e4faf333852d None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:19.235795 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:19.256389 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352ef3f-d84c-4b7f-b268-b551081e3864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:19.257043 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352ef3f-d84c-4b7f-b268-b551081e3864 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:19.257324 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352ef3f-d84c-4b7f-b268-b551081e3864 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:19.257599 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352ef3f-d84c-4b7f-b268-b551081e3864 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:19.267789 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352ef3f-d84c-4b7f-b268-b551081e3864 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:19.269704 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352ef3f-d84c-4b7f-b268-b551081e3864 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:19.285417 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce861b1-40d6-4d42-9f0d-54a177ac85eb None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:19.285589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-f352ef3f-d84c-4b7f-b268-b551081e3864 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:13:19.285589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:19.285589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:19.285589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:19.285589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:19.285589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:19.285589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:19.285589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:19.285589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:19.285589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:19.285589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:19.285589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:19.285589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:13:19.285589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:13:19.285589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:13:19.286418 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:13:19.286418 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:19.286418 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:19.286418 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:19.286418 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:19.286418 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:19.286418 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:19.286418 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:19.286418 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:19.286418 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:19.286418 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:19.286418 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:19.286418 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:19.286418 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:19.286418 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:19.286418 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:19.286418 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:19.287303 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:13:19.287303 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:13:19.287303 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:13:19.287303 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:13:19.287303 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:13:19.287303 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:13:19.287303 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:13:19.287303 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:19.292022 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 350/698] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:13:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:13:19.293946 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352ef3f-d84c-4b7f-b268-b551081e3864 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:19.330715 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cef65-a0eb-45b0-9bbf-8083df414c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:19.331862 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cef65-a0eb-45b0-9bbf-8083df414c61 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:19.332347 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cef65-a0eb-45b0-9bbf-8083df414c61 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:19.332849 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cef65-a0eb-45b0-9bbf-8083df414c61 None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:19.333817 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cef65-a0eb-45b0-9bbf-8083df414c61 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:19.334420 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cef65-a0eb-45b0-9bbf-8083df414c61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:19.336032 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cef65-a0eb-45b0-9bbf-8083df414c61 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:19.346591 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 349/699] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Jul 27 16:13:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:19.347879 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cef65-a0eb-45b0-9bbf-8083df414c61 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:19.419959 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352ef3f-d84c-4b7f-b268-b551081e3864 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:19.422368 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:19.459595 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cef65-a0eb-45b0-9bbf-8083df414c61 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:19.460567 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc7c9b-a503-4afa-a97c-ea0f4f079835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:19.461186 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc7c9b-a503-4afa-a97c-ea0f4f079835 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:19.461468 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc7c9b-a503-4afa-a97c-ea0f4f079835 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:19.461733 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc7c9b-a503-4afa-a97c-ea0f4f079835 None admin] PATH_INFO: `/v3/projects` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:19.462523 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc7c9b-a503-4afa-a97c-ea0f4f079835 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:19.462828 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc7c9b-a503-4afa-a97c-ea0f4f079835 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:19.464279 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc7c9b-a503-4afa-a97c-ea0f4f079835 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:19.480079 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 351/700] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 16:13:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:19.480079 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5616767-0ed4-4f70-be61-eeb12e8c4ca5 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:19.480079 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5616767-0ed4-4f70-be61-eeb12e8c4ca5 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:19.480079 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5616767-0ed4-4f70-be61-eeb12e8c4ca5 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:19.481116 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 352/701] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:13:19.486272 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa2aad-4719-4aec-a6c0-097da86e4bb6 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:19.486559 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa2aad-4719-4aec-a6c0-097da86e4bb6 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:19.486835 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa2aad-4719-4aec-a6c0-097da86e4bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:19.504563 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-93aa2aad-4719-4aec-a6c0-097da86e4bb6 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:19.505004 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b425a6c-41fc-4931-84b8-0feded842118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:19.505643 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b425a6c-41fc-4931-84b8-0feded842118 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:19.505745 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-93aa2aad-4719-4aec-a6c0-097da86e4bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:19.505932 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b425a6c-41fc-4931-84b8-0feded842118 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:19.506214 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b425a6c-41fc-4931-84b8-0feded842118 None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:19.506896 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b425a6c-41fc-4931-84b8-0feded842118 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:19.507208 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b425a6c-41fc-4931-84b8-0feded842118 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:19.509429 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b425a6c-41fc-4931-84b8-0feded842118 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:19.519085 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 350/702] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Jul 27 16:13:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:19.519085 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b425a6c-41fc-4931-84b8-0feded842118 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:19.550984 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:19.588301 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 353/703] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:19 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 16:13:19.597209 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa2aad-4719-4aec-a6c0-097da86e4bb6 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:19.627600 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b425a6c-41fc-4931-84b8-0feded842118 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:19.659031 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:19.666197 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668630e5-1616-4e89-a86b-489b42f84e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:19.666880 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668630e5-1616-4e89-a86b-489b42f84e27 None admin] REQUEST_METHOD: `PUT` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:19.667178 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668630e5-1616-4e89-a86b-489b42f84e27 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:19.667477 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668630e5-1616-4e89-a86b-489b42f84e27 None admin] PATH_INFO: `/v3/projects/73d63a3d7b724a5998ea2976430f242d/users/66768f9443c046b3bd75853a4b2b980e/roles/76e01abae9964dd5b28fc8895f739ee4` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:19.669515 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668630e5-1616-4e89-a86b-489b42f84e27 None admin] RBAC: Authorizing `identity:create_grant(project_id=73d63a3d7b724a5998ea2976430f242d, user_id=66768f9443c046b3bd75853a4b2b980e, role_id=76e01abae9964dd5b28fc8895f739ee4)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:19.673497 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668630e5-1616-4e89-a86b-489b42f84e27 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:19.686055 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 351/704] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 16:13:19 2022] PUT /identity/v3/projects/73d63a3d7b724a5998ea2976430f242d/users/66768f9443c046b3bd75853a4b2b980e/roles/76e01abae9964dd5b28fc8895f739ee4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:13:19.686635 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668630e5-1616-4e89-a86b-489b42f84e27 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:19.733012 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa2aad-4719-4aec-a6c0-097da86e4bb6 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:19.788635 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bc391-69a8-46bf-8fbc-e0724169c421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:19.790385 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bc391-69a8-46bf-8fbc-e0724169c421 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:19.791096 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bc391-69a8-46bf-8fbc-e0724169c421 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:19.791706 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bc391-69a8-46bf-8fbc-e0724169c421 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:19.792700 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1bc391-69a8-46bf-8fbc-e0724169c421 None admin] RBAC: Adding query filter params (interface=public, service_id=5c508d25a521458f943cb5b2583c9c89, region_id=RegionOne) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:19.793489 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1bc391-69a8-46bf-8fbc-e0724169c421 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:19.795993 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1bc391-69a8-46bf-8fbc-e0724169c421 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:19.809260 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 354/705] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Jul 27 16:13:19 2022] GET /identity/v3/endpoints?service_id=5c508d25a521458f943cb5b2583c9c89&interface=public®ion_id=RegionOne => generated 194 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:19.814893 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bc391-69a8-46bf-8fbc-e0724169c421 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:19.820076 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668630e5-1616-4e89-a86b-489b42f84e27 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:19.860287 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:19.867112 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53607dee-3d48-425d-8459-e7daf79b55c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:19.868524 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53607dee-3d48-425d-8459-e7daf79b55c5 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:19.869008 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53607dee-3d48-425d-8459-e7daf79b55c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:19.869481 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53607dee-3d48-425d-8459-e7daf79b55c5 None admin] PATH_INFO: `/v3/services/network` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:19.870314 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53607dee-3d48-425d-8459-e7daf79b55c5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:19.871954 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53607dee-3d48-425d-8459-e7daf79b55c5 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:19.882523 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-53607dee-3d48-425d-8459-e7daf79b55c5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 16:13:19.882523 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:19.882523 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:13:19.882523 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:13:19.882523 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:13:19.882523 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:13:19.882523 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:13:19.882523 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:19.882523 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 16:13:19.882523 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:19.882523 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:13:19.882523 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:19.882523 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:19.882523 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:19.882523 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:19.882523 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:19.882523 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:19.883634 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:19.883634 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:19.883634 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:19.883634 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:19.883634 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:19.883634 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:19.883634 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:13:19.883634 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:13:19.883634 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:13:19.883634 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:13:19.883634 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:19.883634 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:19.883634 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:19.883634 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:19.883634 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:19.883634 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:19.884479 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:19.884479 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:19.884479 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:19.884479 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:19.884479 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:19.884479 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:19.884479 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:19.884479 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:19.884479 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:19.884479 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:19.884479 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:13:19.884479 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:19.884479 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 16:13:19.884479 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:19.886533 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 352/706] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:13:19 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:19.896351 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53607dee-3d48-425d-8459-e7daf79b55c5 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:19.944507 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bc391-69a8-46bf-8fbc-e0724169c421 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:19.982397 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:19.983495 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc40f7-2190-4b25-bf29-64d5c56fc3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:19.984343 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc40f7-2190-4b25-bf29-64d5c56fc3b0 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:19.984741 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc40f7-2190-4b25-bf29-64d5c56fc3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:19.985142 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc40f7-2190-4b25-bf29-64d5c56fc3b0 None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:19.985988 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc40f7-2190-4b25-bf29-64d5c56fc3b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:19.987572 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc40f7-2190-4b25-bf29-64d5c56fc3b0 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:19.994973 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 355/707] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Jul 27 16:13:19 2022] GET /identity/v3/services => generated 1002 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:13:20.041951 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53607dee-3d48-425d-8459-e7daf79b55c5 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:20.084324 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a75c65-5cd3-4344-b675-a5e40a434a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:20.085247 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a75c65-5cd3-4344-b675-a5e40a434a40 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:20.085681 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a75c65-5cd3-4344-b675-a5e40a434a40 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:20.086102 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a75c65-5cd3-4344-b675-a5e40a434a40 None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:20.086961 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a75c65-5cd3-4344-b675-a5e40a434a40 None admin] RBAC: Adding query filter params (name=network) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:20.087450 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a75c65-5cd3-4344-b675-a5e40a434a40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:20.089019 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a75c65-5cd3-4344-b675-a5e40a434a40 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:20.095924 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 353/708] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 16:13:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:13:20.104249 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc40f7-2190-4b25-bf29-64d5c56fc3b0 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:20.212991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:20.216968 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc40f7-2190-4b25-bf29-64d5c56fc3b0 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:20.253097 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48474d1e-84c1-4457-9fd5-a8b5c949ed74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:20.253724 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48474d1e-84c1-4457-9fd5-a8b5c949ed74 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:20.254008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48474d1e-84c1-4457-9fd5-a8b5c949ed74 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:20.254291 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48474d1e-84c1-4457-9fd5-a8b5c949ed74 None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:20.254968 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48474d1e-84c1-4457-9fd5-a8b5c949ed74 None admin] RBAC: Adding query filter params (type=network) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:20.255274 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48474d1e-84c1-4457-9fd5-a8b5c949ed74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:20.256757 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48474d1e-84c1-4457-9fd5-a8b5c949ed74 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:20.263405 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 356/709] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 16:13:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:20.269847 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a75c65-5cd3-4344-b675-a5e40a434a40 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:20.376835 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a75c65-5cd3-4344-b675-a5e40a434a40 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:20.399346 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:20.420257 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba123719-5a05-4a9d-a7c8-2ed7db1c397f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:20.420963 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba123719-5a05-4a9d-a7c8-2ed7db1c397f None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:20.421247 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba123719-5a05-4a9d-a7c8-2ed7db1c397f None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:20.422053 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba123719-5a05-4a9d-a7c8-2ed7db1c397f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:20.422809 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba123719-5a05-4a9d-a7c8-2ed7db1c397f None admin] RBAC: Adding query filter params (interface=public, service_id=79bbffb64f8649fa973f5c86e44acae1, region_id=RegionOne) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:20.423122 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba123719-5a05-4a9d-a7c8-2ed7db1c397f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:20.424653 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba123719-5a05-4a9d-a7c8-2ed7db1c397f None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:20.430540 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 354/710] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Jul 27 16:13:20 2022] GET /identity/v3/endpoints?service_id=79bbffb64f8649fa973f5c86e44acae1&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:20.437749 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48474d1e-84c1-4457-9fd5-a8b5c949ed74 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:20.550000 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48474d1e-84c1-4457-9fd5-a8b5c949ed74 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:20.586760 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dc099-89bf-4bd9-9d95-b520ed97ccba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:20.587420 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dc099-89bf-4bd9-9d95-b520ed97ccba None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:20.587719 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dc099-89bf-4bd9-9d95-b520ed97ccba None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:20.588000 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dc099-89bf-4bd9-9d95-b520ed97ccba None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:20.588662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6dc099-89bf-4bd9-9d95-b520ed97ccba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:20.590054 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6dc099-89bf-4bd9-9d95-b520ed97ccba None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:20.596799 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 357/711] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Jul 27 16:13:20 2022] GET /identity/v3/services => generated 1002 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:13:21.119143 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77311b73-d31f-44dc-9486-ce8eda7a99d9 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:21.119723 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77311b73-d31f-44dc-9486-ce8eda7a99d9 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:21.119723 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77311b73-d31f-44dc-9486-ce8eda7a99d9 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:21.121226 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 355/712] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:13:21.127113 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745da7f8-6114-441a-9842-fb0371217805 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:21.127430 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745da7f8-6114-441a-9842-fb0371217805 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:21.127725 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745da7f8-6114-441a-9842-fb0371217805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:21.146714 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-745da7f8-6114-441a-9842-fb0371217805 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:21.147921 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-745da7f8-6114-441a-9842-fb0371217805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:21.169214 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:21.221939 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 358/713] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:21 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:13:21.246061 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77311b73-d31f-44dc-9486-ce8eda7a99d9 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:21.355662 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77311b73-d31f-44dc-9486-ce8eda7a99d9 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:21.392001 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10fb71-308a-4d24-910d-1ea4c032e669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:21.392571 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10fb71-308a-4d24-910d-1ea4c032e669 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:21.392856 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10fb71-308a-4d24-910d-1ea4c032e669 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:21.393136 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10fb71-308a-4d24-910d-1ea4c032e669 None admin] PATH_INFO: `/v3/services/image` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:21.393766 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10fb71-308a-4d24-910d-1ea4c032e669 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:21.395126 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10fb71-308a-4d24-910d-1ea4c032e669 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:21.404282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-2b10fb71-308a-4d24-910d-1ea4c032e669 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 16:13:21.404282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:21.404282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:13:21.404282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:13:21.404282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:13:21.404282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:13:21.404282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:13:21.404282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:21.404282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 16:13:21.404282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:21.404282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:13:21.404282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:21.404282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:21.404282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:21.404282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:21.404282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:21.404282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:21.405328 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:21.405328 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:21.405328 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:21.405328 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:21.405328 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:21.405328 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:21.405328 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:13:21.405328 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:13:21.405328 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:13:21.405328 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:13:21.405328 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:21.405328 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:21.405328 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:21.405328 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:21.405328 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:21.405328 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:21.406743 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:21.406743 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:21.406743 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:21.406743 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:21.406743 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:21.406743 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:21.406743 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:21.406743 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:21.406743 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:21.406743 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:21.406743 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:13:21.406743 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:21.406743 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 16:13:21.406743 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:21.406743 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 356/714] 10.222.0.65 () {56 vars in 1105 bytes} [Wed Jul 27 16:13:21 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:21.414016 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745da7f8-6114-441a-9842-fb0371217805 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:21.524570 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745da7f8-6114-441a-9842-fb0371217805 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:21.560779 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5ef00-ce82-4b98-9cb9-942f06cb4bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:21.561845 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5ef00-ce82-4b98-9cb9-942f06cb4bd8 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:21.562984 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5ef00-ce82-4b98-9cb9-942f06cb4bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:21.563622 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5ef00-ce82-4b98-9cb9-942f06cb4bd8 None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:21.564559 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5ef00-ce82-4b98-9cb9-942f06cb4bd8 None admin] RBAC: Adding query filter params (name=image) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:21.565086 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5ef00-ce82-4b98-9cb9-942f06cb4bd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:21.566663 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5ef00-ce82-4b98-9cb9-942f06cb4bd8 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:21.571977 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 359/715] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:13:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:21.578014 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10fb71-308a-4d24-910d-1ea4c032e669 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:21.631576 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:21.686644 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10fb71-308a-4d24-910d-1ea4c032e669 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:21.722570 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655a3dc-c811-4961-934b-ac600c1e5d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:21.723212 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655a3dc-c811-4961-934b-ac600c1e5d1d None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:21.723539 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655a3dc-c811-4961-934b-ac600c1e5d1d None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:21.723810 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655a3dc-c811-4961-934b-ac600c1e5d1d None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:21.724501 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655a3dc-c811-4961-934b-ac600c1e5d1d None admin] RBAC: Adding query filter params (type=image) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:21.724809 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655a3dc-c811-4961-934b-ac600c1e5d1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:21.726188 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655a3dc-c811-4961-934b-ac600c1e5d1d None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:21.731985 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 357/716] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:13:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:21.738279 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5ef00-ce82-4b98-9cb9-942f06cb4bd8 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:21.763791 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:21.849925 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5ef00-ce82-4b98-9cb9-942f06cb4bd8 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:21.886949 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ef524-1f93-4969-a9a1-f2b4cb3c9beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:21.887993 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ef524-1f93-4969-a9a1-f2b4cb3c9beb None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:21.888510 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ef524-1f93-4969-a9a1-f2b4cb3c9beb None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:21.888993 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ef524-1f93-4969-a9a1-f2b4cb3c9beb None admin] PATH_INFO: `/v3/endpoints` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:21.889916 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ef524-1f93-4969-a9a1-f2b4cb3c9beb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:21.891564 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ef524-1f93-4969-a9a1-f2b4cb3c9beb None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:21.919001 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 360/717] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 16:13:21 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:13:22.101434 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74e895-6551-40dc-a6b3-aa80567725aa None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:22.101774 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74e895-6551-40dc-a6b3-aa80567725aa None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:22.102121 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74e895-6551-40dc-a6b3-aa80567725aa None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:22.103821 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 358/718] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:13:22.109263 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97037373-511a-460e-b4e4-d617bab2157d None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:22.109557 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97037373-511a-460e-b4e4-d617bab2157d None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:22.109842 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97037373-511a-460e-b4e4-d617bab2157d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:22.131696 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-97037373-511a-460e-b4e4-d617bab2157d None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:22.132930 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-97037373-511a-460e-b4e4-d617bab2157d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:22.214928 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 361/719] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:22 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:13:22.239414 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74e895-6551-40dc-a6b3-aa80567725aa None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:22.355347 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74e895-6551-40dc-a6b3-aa80567725aa None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:22.366768 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:22.392398 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e57b2-ce68-4e24-9696-0643adcd3621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:22.393048 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e57b2-ce68-4e24-9696-0643adcd3621 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:22.393332 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e57b2-ce68-4e24-9696-0643adcd3621 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:22.393608 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e57b2-ce68-4e24-9696-0643adcd3621 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:22.404607 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e57b2-ce68-4e24-9696-0643adcd3621 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:13:22.410192 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-346e57b2-ce68-4e24-9696-0643adcd3621 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:13:22.410192 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:22.410192 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:22.410192 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:22.410192 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:22.410192 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:22.410192 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:22.410192 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:22.410192 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:22.410192 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:22.410192 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:22.410192 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:22.410192 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:13:22.410192 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:13:22.410192 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:13:22.410192 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:13:22.411108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:13:22.411108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:13:22.411108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:13:22.411108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:13:22.411108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:22.411108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:22.411108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:22.411108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:22.411108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:22.411108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:22.411108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:22.411108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:22.411108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:22.411108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:22.411108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:22.411108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:22.411986 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:22.411986 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:22.411986 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:22.411986 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:22.411986 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:13:22.411986 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:13:22.411986 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:13:22.411986 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:13:22.411986 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:13:22.411986 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:13:22.411986 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:13:22.411986 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:22.411986 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 359/720] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 16:13:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:22.417703 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97037373-511a-460e-b4e4-d617bab2157d None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:22.420064 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:22.448766 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ae885-bbf2-4df8-8e1f-93f92ebf619c None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:22.449100 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ae885-bbf2-4df8-8e1f-93f92ebf619c None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:22.449372 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ae885-bbf2-4df8-8e1f-93f92ebf619c None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:22.450938 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 360/721] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:13:22.461688 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcf7a9-ecd8-4bbd-b11e-d781581e60c5 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:22.461980 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcf7a9-ecd8-4bbd-b11e-d781581e60c5 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:22.462243 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcf7a9-ecd8-4bbd-b11e-d781581e60c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:22.486350 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-02dcf7a9-ecd8-4bbd-b11e-d781581e60c5 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:22.487639 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-02dcf7a9-ecd8-4bbd-b11e-d781581e60c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:22.554791 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97037373-511a-460e-b4e4-d617bab2157d None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:22.572061 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 361/722] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:22 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:13:22.595866 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dcf7a9-ecd8-4bbd-b11e-d781581e60c5 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:22.597182 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8eae6a-7f8d-4d22-8325-6482e24ea5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:22.597808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8eae6a-7f8d-4d22-8325-6482e24ea5ce None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:22.598089 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8eae6a-7f8d-4d22-8325-6482e24ea5ce None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:22.598406 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8eae6a-7f8d-4d22-8325-6482e24ea5ce None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:22.599331 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8eae6a-7f8d-4d22-8325-6482e24ea5ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:22.599667 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8eae6a-7f8d-4d22-8325-6482e24ea5ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:22.602037 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8eae6a-7f8d-4d22-8325-6482e24ea5ce None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:22.614334 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 362/723] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:13:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:22.619594 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8eae6a-7f8d-4d22-8325-6482e24ea5ce None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:22.699332 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:22.720027 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:22.725682 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dcf7a9-ecd8-4bbd-b11e-d781581e60c5 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:22.742621 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8eae6a-7f8d-4d22-8325-6482e24ea5ce None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:22.771353 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d9ca1-06ef-43d9-b56d-ed56c846cfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:22.772913 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d9ca1-06ef-43d9-b56d-ed56c846cfa2 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:22.773374 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d9ca1-06ef-43d9-b56d-ed56c846cfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:22.774061 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d9ca1-06ef-43d9-b56d-ed56c846cfa2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:22.775128 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d9ca1-06ef-43d9-b56d-ed56c846cfa2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:22.777381 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d9ca1-06ef-43d9-b56d-ed56c846cfa2 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:22.781706 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41ba35-82ac-4bf7-ab1f-41550afa15e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:22.782437 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41ba35-82ac-4bf7-ab1f-41550afa15e9 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:22.782796 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41ba35-82ac-4bf7-ab1f-41550afa15e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:22.783151 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41ba35-82ac-4bf7-ab1f-41550afa15e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:22.788841 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-766d9ca1-06ef-43d9-b56d-ed56c846cfa2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 16:13:22.788841 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:22.788841 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:13:22.788841 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:13:22.788841 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:13:22.788841 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:13:22.788841 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:13:22.788841 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:22.788841 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 16:13:22.788841 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:22.788841 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:13:22.788841 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:22.788841 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:22.788841 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:22.788841 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:22.788841 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:22.789746 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:22.789746 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:22.789746 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:22.789746 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:22.789746 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:22.789746 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:22.789746 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:22.789746 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:13:22.789746 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:13:22.789746 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:13:22.789746 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:13:22.789746 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:22.789746 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:22.789746 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:22.789746 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:22.789746 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:22.790831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:22.790831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:22.790831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:22.790831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:22.790831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:22.790831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:22.790831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:22.790831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:22.790831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:22.790831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:22.790831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:22.790831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:13:22.790831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:22.790831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 16:13:22.790831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:22.798229 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 362/724] 10.222.0.65 () {56 vars in 1129 bytes} [Wed Jul 27 16:13:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:13:22.798561 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41ba35-82ac-4bf7-ab1f-41550afa15e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:22.800078 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41ba35-82ac-4bf7-ab1f-41550afa15e9 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:22.800579 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d9ca1-06ef-43d9-b56d-ed56c846cfa2 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:22.817655 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-9b41ba35-82ac-4bf7-ab1f-41550afa15e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:22.817655 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:22.817655 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:22.817655 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:22.817655 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:22.817655 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:22.817655 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:22.817655 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:22.817655 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:22.817655 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:22.817655 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:22.817655 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:22.817655 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:13:22.817655 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:13:22.817655 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:13:22.818639 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:13:22.818639 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:22.818639 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:22.818639 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:22.818639 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:22.818639 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:22.818639 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:22.818639 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:22.818639 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:22.818639 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:22.818639 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:22.818639 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:22.818639 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:22.818639 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:22.818639 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:22.818639 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:22.818639 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:22.819553 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:13:22.819553 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:13:22.819553 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:22.819553 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:22.823706 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 363/725] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:13:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:13:22.825435 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41ba35-82ac-4bf7-ab1f-41550afa15e9 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:22.915277 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d9ca1-06ef-43d9-b56d-ed56c846cfa2 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:22.944788 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41ba35-82ac-4bf7-ab1f-41550afa15e9 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:22.951226 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95917be1-a5c1-4d01-92af-2fd93432b95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:22.952088 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95917be1-a5c1-4d01-92af-2fd93432b95e None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:22.952591 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95917be1-a5c1-4d01-92af-2fd93432b95e None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:22.953551 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95917be1-a5c1-4d01-92af-2fd93432b95e None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:22.954446 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95917be1-a5c1-4d01-92af-2fd93432b95e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:22.954957 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95917be1-a5c1-4d01-92af-2fd93432b95e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:22.956568 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95917be1-a5c1-4d01-92af-2fd93432b95e None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:22.965951 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:22.966866 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 363/726] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Jul 27 16:13:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:22.968025 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95917be1-a5c1-4d01-92af-2fd93432b95e None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:22.984790 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a45b95-7c7f-4d4d-a5e5-8a38ba680e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:22.985418 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a45b95-7c7f-4d4d-a5e5-8a38ba680e31 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:22.985706 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a45b95-7c7f-4d4d-a5e5-8a38ba680e31 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:22.985985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a45b95-7c7f-4d4d-a5e5-8a38ba680e31 None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:22.986792 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a45b95-7c7f-4d4d-a5e5-8a38ba680e31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:22.987105 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a45b95-7c7f-4d4d-a5e5-8a38ba680e31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:22.988622 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a45b95-7c7f-4d4d-a5e5-8a38ba680e31 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:23.001074 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:23.007321 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 364/727] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:13:23.009840 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a05cd-687f-4b6d-a8f5-297bb3311892 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:23.010139 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a05cd-687f-4b6d-a8f5-297bb3311892 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:23.010421 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a05cd-687f-4b6d-a8f5-297bb3311892 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:23.011923 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 365/728] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:13:23.016543 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a05cd-687f-4b6d-a8f5-297bb3311892 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:23.082827 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95917be1-a5c1-4d01-92af-2fd93432b95e None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:23.122933 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a8814-a2b8-45d2-9cc2-e89d3bea3a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:23.123602 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a8814-a2b8-45d2-9cc2-e89d3bea3a18 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:23.123891 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a8814-a2b8-45d2-9cc2-e89d3bea3a18 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:23.124168 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a8814-a2b8-45d2-9cc2-e89d3bea3a18 None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:23.124923 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a8814-a2b8-45d2-9cc2-e89d3bea3a18 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:23.125193 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a05cd-687f-4b6d-a8f5-297bb3311892 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:23.125307 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a8814-a2b8-45d2-9cc2-e89d3bea3a18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:23.126600 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a8814-a2b8-45d2-9cc2-e89d3bea3a18 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:23.132296 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 364/729] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Jul 27 16:13:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:23.133568 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d91e4-8289-46e0-8a64-04cb74cd8a5f None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:23.133858 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d91e4-8289-46e0-8a64-04cb74cd8a5f None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:23.134134 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d91e4-8289-46e0-8a64-04cb74cd8a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:23.153342 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-241d91e4-8289-46e0-8a64-04cb74cd8a5f None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:23.154530 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-241d91e4-8289-46e0-8a64-04cb74cd8a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:23.170226 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33333475-63b5-4c81-9fec-7e52a1df3c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:23.171184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33333475-63b5-4c81-9fec-7e52a1df3c5f None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:23.171701 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33333475-63b5-4c81-9fec-7e52a1df3c5f None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:23.172153 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33333475-63b5-4c81-9fec-7e52a1df3c5f None admin] PATH_INFO: `/v3/users/nova` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:23.183853 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33333475-63b5-4c81-9fec-7e52a1df3c5f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:23.185653 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33333475-63b5-4c81-9fec-7e52a1df3c5f None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:23.199304 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-33333475-63b5-4c81-9fec-7e52a1df3c5f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 16:13:23.199304 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:23.199304 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:23.199304 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:23.199304 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:23.199304 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:23.199304 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:23.199304 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:23.199304 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:23.199304 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:23.199304 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:23.199304 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:23.199304 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:13:23.199304 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:13:23.199304 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:13:23.199304 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:13:23.200465 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:23.200465 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:23.200465 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:13:23.200465 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:13:23.200465 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:13:23.200465 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:13:23.200465 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:23.200465 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:23.200465 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:23.200465 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:23.200465 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:23.200465 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:23.200465 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:23.200465 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:23.200465 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:23.200465 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:23.200465 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:23.200465 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:23.201457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:23.201457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:23.201457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:13:23.201457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:13:23.201457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:13:23.201457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:13:23.201457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:13:23.201457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:13:23.201457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 16:13:23.201457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:23.201992 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 366/730] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Jul 27 16:13:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:23.202628 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33333475-63b5-4c81-9fec-7e52a1df3c5f None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:23.235252 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 365/731] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:23 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:13:23.236207 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d91e4-8289-46e0-8a64-04cb74cd8a5f None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:23.253367 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:23.262022 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:23.332125 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33333475-63b5-4c81-9fec-7e52a1df3c5f None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:23.348057 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d91e4-8289-46e0-8a64-04cb74cd8a5f None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:23.368284 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4687f-353f-407b-96df-41cbee282adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:23.368915 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4687f-353f-407b-96df-41cbee282adb None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:23.369827 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4687f-353f-407b-96df-41cbee282adb None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:23.369827 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4687f-353f-407b-96df-41cbee282adb None admin] PATH_INFO: `/v3/endpoints` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:23.370175 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4687f-353f-407b-96df-41cbee282adb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:23.371607 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4687f-353f-407b-96df-41cbee282adb None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:23.385163 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a0673-ecfa-4da7-bbca-c8fc3c7f0930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:23.385784 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a0673-ecfa-4da7-bbca-c8fc3c7f0930 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:23.386074 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a0673-ecfa-4da7-bbca-c8fc3c7f0930 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:23.386352 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a0673-ecfa-4da7-bbca-c8fc3c7f0930 None admin] PATH_INFO: `/v3/users` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:23.387145 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a0673-ecfa-4da7-bbca-c8fc3c7f0930 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:23.387487 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a0673-ecfa-4da7-bbca-c8fc3c7f0930 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:23.388954 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a0673-ecfa-4da7-bbca-c8fc3c7f0930 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:23.395789 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 367/732] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 16:13:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:13:23.397068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4687f-353f-407b-96df-41cbee282adb None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:23.413887 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 366/733] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Jul 27 16:13:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:23.415541 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a0673-ecfa-4da7-bbca-c8fc3c7f0930 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:23.517982 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:23.533175 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:23.547990 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a0673-ecfa-4da7-bbca-c8fc3c7f0930 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:23.559568 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4687f-353f-407b-96df-41cbee282adb None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:23.598429 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adecb3-acd8-407b-acbd-97cab1731001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:23.600091 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adecb3-acd8-407b-acbd-97cab1731001 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:23.600576 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adecb3-acd8-407b-acbd-97cab1731001 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:23.600856 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adecb3-acd8-407b-acbd-97cab1731001 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:23.605882 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98146d-a9af-49e2-bb71-ab7b80e3c8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:23.606539 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98146d-a9af-49e2-bb71-ab7b80e3c8bb None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:23.607624 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98146d-a9af-49e2-bb71-ab7b80e3c8bb None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:23.607959 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98146d-a9af-49e2-bb71-ab7b80e3c8bb None admin] PATH_INFO: `/v3/services/network` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:23.608630 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98146d-a9af-49e2-bb71-ab7b80e3c8bb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:23.610735 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98146d-a9af-49e2-bb71-ab7b80e3c8bb None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:23.623867 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-df98146d-a9af-49e2-bb71-ab7b80e3c8bb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 16:13:23.623867 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:23.623867 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:13:23.623867 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:13:23.623867 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:13:23.623867 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:13:23.623867 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:13:23.623867 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:23.623867 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 16:13:23.623867 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:23.623867 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:13:23.623867 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:23.623867 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:23.623867 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:23.623867 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:23.623867 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:23.623867 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:23.624958 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:23.624958 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:23.624958 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:23.624958 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:23.624958 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:23.624958 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:23.624958 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:13:23.624958 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:13:23.624958 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:13:23.624958 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:13:23.624958 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:23.624958 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:23.624958 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:23.624958 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:23.624958 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:23.624958 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:23.625793 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:23.625793 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:23.625793 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:23.625793 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:23.625793 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:23.625793 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:23.625793 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:23.625793 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:23.625793 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:23.625793 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:23.625793 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:13:23.625793 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:23.625793 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 16:13:23.625793 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:23.625793 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 368/734] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:13:23 2022] GET /identity/v3/services/network => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:23.633245 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98146d-a9af-49e2-bb71-ab7b80e3c8bb None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:23.694253 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88adecb3-acd8-407b-acbd-97cab1731001 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:23.695917 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88adecb3-acd8-407b-acbd-97cab1731001 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:23.776955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98146d-a9af-49e2-bb71-ab7b80e3c8bb None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:23.790705 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:23.819822 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 367/735] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:13:23 2022] GET /identity/v3/auth/tokens => generated 1247 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 16:13:23.825505 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adecb3-acd8-407b-acbd-97cab1731001 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:23.830811 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cbcbe-0767-4420-bcf9-fcd7e6d7cf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:23.831510 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cbcbe-0767-4420-bcf9-fcd7e6d7cf9b None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:23.831801 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cbcbe-0767-4420-bcf9-fcd7e6d7cf9b None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:23.832082 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cbcbe-0767-4420-bcf9-fcd7e6d7cf9b None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:23.832779 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767cbcbe-0767-4420-bcf9-fcd7e6d7cf9b None admin] RBAC: Adding query filter params (name=network) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:23.833090 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767cbcbe-0767-4420-bcf9-fcd7e6d7cf9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:23.834508 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767cbcbe-0767-4420-bcf9-fcd7e6d7cf9b None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:23.839985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 369/736] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 16:13:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:13:23.847566 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cbcbe-0767-4420-bcf9-fcd7e6d7cf9b None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:23.871783 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:23.969684 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adecb3-acd8-407b-acbd-97cab1731001 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:23.971036 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cbcbe-0767-4420-bcf9-fcd7e6d7cf9b None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:24.007043 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87d56e-bca7-4591-b3d6-6cfd2a330468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:24.007726 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87d56e-bca7-4591-b3d6-6cfd2a330468 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:24.008105 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87d56e-bca7-4591-b3d6-6cfd2a330468 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:24.008280 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87d56e-bca7-4591-b3d6-6cfd2a330468 None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:24.008974 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87d56e-bca7-4591-b3d6-6cfd2a330468 None admin] RBAC: Adding query filter params (type=network) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:24.009281 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87d56e-bca7-4591-b3d6-6cfd2a330468 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:24.010675 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87d56e-bca7-4591-b3d6-6cfd2a330468 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:24.017670 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fc6f1-1f66-48b6-bd65-3c7d51aaa5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:24.018658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fc6f1-1f66-48b6-bd65-3c7d51aaa5a5 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:24.019149 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fc6f1-1f66-48b6-bd65-3c7d51aaa5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:24.019649 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fc6f1-1f66-48b6-bd65-3c7d51aaa5a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:24.021221 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 370/737] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 16:13:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:24.022130 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87d56e-bca7-4591-b3d6-6cfd2a330468 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:24.034610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0fc6f1-1f66-48b6-bd65-3c7d51aaa5a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:24.037081 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0fc6f1-1f66-48b6-bd65-3c7d51aaa5a5 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:24.058564 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-7c0fc6f1-1f66-48b6-bd65-3c7d51aaa5a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:24.058564 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:24.058564 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:24.058564 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:24.058564 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:24.058564 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:24.058564 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:24.058564 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:24.058564 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:24.058564 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:24.058564 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:24.058564 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:24.058564 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:13:24.058564 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:13:24.058564 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:13:24.059586 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:13:24.059586 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:24.059586 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:24.059586 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:24.059586 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:24.059586 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:24.059586 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:24.059586 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:24.059586 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:24.059586 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:24.059586 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:24.059586 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:24.059586 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:24.059586 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:24.059586 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:24.059586 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:24.059586 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:24.060484 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:13:24.060484 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:13:24.060484 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:24.060484 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:24.066626 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 368/738] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:13:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:24.068151 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fc6f1-1f66-48b6-bd65-3c7d51aaa5a5 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:24.102443 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:24.133036 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:24.169253 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87d56e-bca7-4591-b3d6-6cfd2a330468 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:24.189153 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fc6f1-1f66-48b6-bd65-3c7d51aaa5a5 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:24.219195 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bad8bc-8e7b-44cd-b678-01a96e960e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:24.220428 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bad8bc-8e7b-44cd-b678-01a96e960e65 None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:24.220919 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bad8bc-8e7b-44cd-b678-01a96e960e65 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:24.221663 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bad8bc-8e7b-44cd-b678-01a96e960e65 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:24.223029 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bad8bc-8e7b-44cd-b678-01a96e960e65 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:24.224983 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bad8bc-8e7b-44cd-b678-01a96e960e65 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:24.226409 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525a3bf-7e3b-4b77-95dd-56b65117f36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:24.227109 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525a3bf-7e3b-4b77-95dd-56b65117f36b None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:24.227536 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525a3bf-7e3b-4b77-95dd-56b65117f36b None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:24.227915 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525a3bf-7e3b-4b77-95dd-56b65117f36b None admin] PATH_INFO: `/v3/domains` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:24.228688 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525a3bf-7e3b-4b77-95dd-56b65117f36b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:24.229069 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525a3bf-7e3b-4b77-95dd-56b65117f36b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:24.230502 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525a3bf-7e3b-4b77-95dd-56b65117f36b None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:24.249456 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 369/739] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:13:24.251246 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525a3bf-7e3b-4b77-95dd-56b65117f36b None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:24.252302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 371/740] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 16:13:24 2022] POST /identity/v3/endpoints => generated 327 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:13:24.304496 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a28c6-19c2-41cd-bb66-17ba5ee1693a None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:24.305098 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a28c6-19c2-41cd-bb66-17ba5ee1693a None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:24.305560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a28c6-19c2-41cd-bb66-17ba5ee1693a None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:24.308430 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 372/741] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:13:24.315629 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9f034-e56c-40a5-b6eb-f3486d674a30 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:24.315916 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9f034-e56c-40a5-b6eb-f3486d674a30 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:24.316197 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9f034-e56c-40a5-b6eb-f3486d674a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:24.335607 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-8aa9f034-e56c-40a5-b6eb-f3486d674a30 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:24.336829 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-8aa9f034-e56c-40a5-b6eb-f3486d674a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:24.385366 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:24.400507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525a3bf-7e3b-4b77-95dd-56b65117f36b None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:24.428044 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 373/742] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:24 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 16:13:24.448207 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9f034-e56c-40a5-b6eb-f3486d674a30 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:24.455424 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159558c7-7bc9-450a-a23f-21e7b1a42d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:24.456171 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159558c7-7bc9-450a-a23f-21e7b1a42d16 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:24.456543 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159558c7-7bc9-450a-a23f-21e7b1a42d16 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:24.456883 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159558c7-7bc9-450a-a23f-21e7b1a42d16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:24.465485 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159558c7-7bc9-450a-a23f-21e7b1a42d16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:24.467031 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159558c7-7bc9-450a-a23f-21e7b1a42d16 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:24.488099 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-159558c7-7bc9-450a-a23f-21e7b1a42d16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:13:24.488099 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:24.488099 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:24.488099 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:24.488099 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:24.488099 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:24.488099 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:24.488099 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:24.488099 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:24.488099 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:24.488099 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:24.488099 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:24.488099 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:13:24.488099 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:13:24.488099 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:13:24.489035 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:13:24.489035 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:24.489035 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:24.489035 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:24.489035 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:24.489035 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:24.489035 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:24.489035 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:24.489035 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:24.489035 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:24.489035 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:24.489035 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:24.489035 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:24.489035 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:24.489035 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:24.489035 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:24.489035 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:24.489923 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:13:24.489923 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:13:24.489923 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:13:24.489923 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:13:24.489923 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:13:24.489923 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:13:24.489923 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:13:24.489923 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:24.489923 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 370/743] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:13:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:24.495399 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159558c7-7bc9-450a-a23f-21e7b1a42d16 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:24.537992 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:24.586142 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9f034-e56c-40a5-b6eb-f3486d674a30 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:24.607944 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159558c7-7bc9-450a-a23f-21e7b1a42d16 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:24.629796 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb9136-96e6-4424-934e-4c76d4927803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:24.630330 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb9136-96e6-4424-934e-4c76d4927803 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:24.630970 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb9136-96e6-4424-934e-4c76d4927803 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:24.630970 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb9136-96e6-4424-934e-4c76d4927803 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:24.646151 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20cc6f-f9b8-45ae-8177-a9732da805f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:24.646998 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20cc6f-f9b8-45ae-8177-a9732da805f0 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:24.647359 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20cc6f-f9b8-45ae-8177-a9732da805f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:24.647730 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20cc6f-f9b8-45ae-8177-a9732da805f0 None admin] PATH_INFO: `/v3/projects` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:24.648574 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20cc6f-f9b8-45ae-8177-a9732da805f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:24.648960 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20cc6f-f9b8-45ae-8177-a9732da805f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:24.650762 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20cc6f-f9b8-45ae-8177-a9732da805f0 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:24.668081 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 371/744] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 16:13:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:24.671105 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20cc6f-f9b8-45ae-8177-a9732da805f0 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:24.686957 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:24.712577 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb9136-96e6-4424-934e-4c76d4927803 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:24.714151 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb9136-96e6-4424-934e-4c76d4927803 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:24.779483 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:24.780481 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20cc6f-f9b8-45ae-8177-a9732da805f0 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:24.818649 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da327e80-3929-46c6-9017-30c522d29c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:24.819361 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da327e80-3929-46c6-9017-30c522d29c65 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:24.819845 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da327e80-3929-46c6-9017-30c522d29c65 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:24.820086 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da327e80-3929-46c6-9017-30c522d29c65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:24.820989 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da327e80-3929-46c6-9017-30c522d29c65 None admin] RBAC: Adding query filter params (role.id=76e01abae9964dd5b28fc8895f739ee4, scope.project.id=73d63a3d7b724a5998ea2976430f242d, user.id=66768f9443c046b3bd75853a4b2b980e) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:24.821297 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da327e80-3929-46c6-9017-30c522d29c65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:24.822716 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da327e80-3929-46c6-9017-30c522d29c65 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:24.827410 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 374/745] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:13:24 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 16:13:24.832332 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb9136-96e6-4424-934e-4c76d4927803 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:24.834234 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 372/746] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 16:13:24 2022] GET /identity/v3/role_assignments?user.id=66768f9443c046b3bd75853a4b2b980e&scope.project.id=73d63a3d7b724a5998ea2976430f242d&role.id=76e01abae9964dd5b28fc8895f739ee4 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:24.945118 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb9136-96e6-4424-934e-4c76d4927803 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:24.981729 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127a7f0-279e-4114-b3d5-5723c61ca161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:24.982394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127a7f0-279e-4114-b3d5-5723c61ca161 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:24.982681 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127a7f0-279e-4114-b3d5-5723c61ca161 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:24.982965 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127a7f0-279e-4114-b3d5-5723c61ca161 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:24.994822 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127a7f0-279e-4114-b3d5-5723c61ca161 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:24.996448 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127a7f0-279e-4114-b3d5-5723c61ca161 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:25.012256 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-7127a7f0-279e-4114-b3d5-5723c61ca161 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:25.012256 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:25.012256 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:25.012256 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:25.012256 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:25.012256 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:25.012256 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:25.012256 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:25.012256 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:25.012256 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:25.012256 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:25.012256 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:25.012256 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:13:25.012256 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:13:25.012256 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:13:25.013215 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:13:25.013215 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:25.013215 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:25.013215 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:25.013215 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:25.013215 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:25.013215 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:25.013215 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:25.013215 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:25.013215 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:25.013215 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:25.013215 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:25.013215 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:25.013215 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:25.013215 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:25.013215 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:25.013215 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:25.014236 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:13:25.014236 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:13:25.014236 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:13:25.014236 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:25.014236 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 375/747] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:13:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:25.019643 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da327e80-3929-46c6-9017-30c522d29c65 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:25.104923 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:25.129769 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da327e80-3929-46c6-9017-30c522d29c65 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:25.166246 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a481daa-1f91-4460-be1f-057880338026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:25.167023 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a481daa-1f91-4460-be1f-057880338026 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:25.167431 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a481daa-1f91-4460-be1f-057880338026 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:25.167817 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a481daa-1f91-4460-be1f-057880338026 None admin] PATH_INFO: `/v3/domains` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:25.168618 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a481daa-1f91-4460-be1f-057880338026 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:25.169039 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a481daa-1f91-4460-be1f-057880338026 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:25.170510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a481daa-1f91-4460-be1f-057880338026 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:25.183338 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 373/748] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:25.749716 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664147f-56f5-4e52-a640-fc8676d63e57 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:25.750258 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664147f-56f5-4e52-a640-fc8676d63e57 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:25.750346 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664147f-56f5-4e52-a640-fc8676d63e57 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:25.751946 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 376/749] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:13:25.757238 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3be288-4222-4714-8f7a-f1230e869c09 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:25.757675 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3be288-4222-4714-8f7a-f1230e869c09 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:25.757860 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3be288-4222-4714-8f7a-f1230e869c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:25.775673 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-5d3be288-4222-4714-8f7a-f1230e869c09 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:25.776861 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-5d3be288-4222-4714-8f7a-f1230e869c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:25.841249 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 374/750] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:25 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:13:25.865296 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664147f-56f5-4e52-a640-fc8676d63e57 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:25.881273 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:25.968165 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664147f-56f5-4e52-a640-fc8676d63e57 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:26.000339 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153eeb9-0547-4418-82b3-9387adcdd82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:26.000973 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153eeb9-0547-4418-82b3-9387adcdd82f None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:26.001256 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153eeb9-0547-4418-82b3-9387adcdd82f None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:26.001535 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153eeb9-0547-4418-82b3-9387adcdd82f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:26.002149 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f153eeb9-0547-4418-82b3-9387adcdd82f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:26.003549 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f153eeb9-0547-4418-82b3-9387adcdd82f None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:26.012449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-f153eeb9-0547-4418-82b3-9387adcdd82f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 16:13:26.012449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:26.012449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:13:26.012449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:13:26.012449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:13:26.012449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:13:26.012449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:13:26.012449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:26.012449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 16:13:26.012449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:26.012449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:13:26.012449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:26.012449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:26.012449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:26.012449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:26.012449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:26.012449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:26.013612 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:26.013612 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:26.013612 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:26.013612 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:26.013612 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:26.013612 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:26.013612 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:13:26.013612 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:13:26.013612 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:13:26.013612 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:13:26.013612 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:26.013612 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:26.013612 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:26.013612 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:26.013612 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:26.013612 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:26.014914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:26.014914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:26.014914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:26.014914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:26.014914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:26.014914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:26.014914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:26.014914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:26.014914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:26.014914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:26.014914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:13:26.014914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:26.014914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 16:13:26.014914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:26.014914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 377/751] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 16:13:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:26.020071 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3be288-4222-4714-8f7a-f1230e869c09 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:26.085519 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:26.120003 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3be288-4222-4714-8f7a-f1230e869c09 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:26.154106 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512e940-1c10-48b7-ad96-b66f123e78c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:26.154731 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512e940-1c10-48b7-ad96-b66f123e78c3 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:26.155012 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512e940-1c10-48b7-ad96-b66f123e78c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:26.155292 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512e940-1c10-48b7-ad96-b66f123e78c3 None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:26.156605 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512e940-1c10-48b7-ad96-b66f123e78c3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:26.156912 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512e940-1c10-48b7-ad96-b66f123e78c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:26.158276 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512e940-1c10-48b7-ad96-b66f123e78c3 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:26.162728 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 375/752] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 16:13:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:26.168648 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153eeb9-0547-4418-82b3-9387adcdd82f None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:26.269266 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:26.291269 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153eeb9-0547-4418-82b3-9387adcdd82f None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:26.324687 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46caf3df-7152-40b1-bee4-957eeeb8b81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:26.325301 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46caf3df-7152-40b1-bee4-957eeeb8b81f None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:26.325584 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46caf3df-7152-40b1-bee4-957eeeb8b81f None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:26.325857 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46caf3df-7152-40b1-bee4-957eeeb8b81f None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:26.326526 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46caf3df-7152-40b1-bee4-957eeeb8b81f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:26.326827 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46caf3df-7152-40b1-bee4-957eeeb8b81f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:26.328784 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46caf3df-7152-40b1-bee4-957eeeb8b81f None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:26.333065 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 378/753] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 16:13:26 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:27.175034 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4cde7-d9cf-4ead-b8e9-f53b11ddaeaf None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:27.175597 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4cde7-d9cf-4ead-b8e9-f53b11ddaeaf None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:27.175597 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4cde7-d9cf-4ead-b8e9-f53b11ddaeaf None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:27.176965 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 376/754] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:13:27.183755 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d5bf4-8043-4859-b04f-a39ee76b641f None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:27.184249 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d5bf4-8043-4859-b04f-a39ee76b641f None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:27.184340 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d5bf4-8043-4859-b04f-a39ee76b641f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:27.212312 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-ae9d5bf4-8043-4859-b04f-a39ee76b641f None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:27.213518 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-ae9d5bf4-8043-4859-b04f-a39ee76b641f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:27.281755 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 379/755] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:27 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:13:27.304460 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4cde7-d9cf-4ead-b8e9-f53b11ddaeaf None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:27.406460 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4cde7-d9cf-4ead-b8e9-f53b11ddaeaf None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:27.435581 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:27.442607 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4c41a-c3ec-49d4-bda5-90c18eb6509b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:27.443273 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4c41a-c3ec-49d4-bda5-90c18eb6509b None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:27.444113 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4c41a-c3ec-49d4-bda5-90c18eb6509b None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:27.444113 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4c41a-c3ec-49d4-bda5-90c18eb6509b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:27.444498 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4c41a-c3ec-49d4-bda5-90c18eb6509b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:27.446254 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4c41a-c3ec-49d4-bda5-90c18eb6509b None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:27.456256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-23c4c41a-c3ec-49d4-bda5-90c18eb6509b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 16:13:27.456256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:27.456256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:13:27.456256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:13:27.456256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:13:27.456256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:13:27.456256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:13:27.456256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:27.456256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 16:13:27.456256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:27.456256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:13:27.456256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:27.456256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:27.456256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:27.456256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:27.456256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:27.457256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:27.457256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:27.457256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:27.457256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:27.457256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:27.457256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:27.457256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:27.457256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:13:27.457256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:13:27.457256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:13:27.457256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:13:27.457256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:27.457256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:27.457256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:27.457256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:27.457256 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:27.458108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:27.458108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:27.458108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:27.458108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:27.458108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:27.458108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:27.458108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:27.458108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:27.458108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:27.458108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:27.458108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:27.458108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:13:27.458108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:27.458108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 16:13:27.458108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:27.458108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 377/756] 10.222.0.65 () {56 vars in 1132 bytes} [Wed Jul 27 16:13:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:13:27.463535 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d5bf4-8043-4859-b04f-a39ee76b641f None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:27.531563 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:27.562979 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d5bf4-8043-4859-b04f-a39ee76b641f None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:27.595995 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a9325-3052-4ba0-bfd2-402f8594daaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:27.596606 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a9325-3052-4ba0-bfd2-402f8594daaf None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:27.596887 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a9325-3052-4ba0-bfd2-402f8594daaf None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:27.597159 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a9325-3052-4ba0-bfd2-402f8594daaf None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:27.597825 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a9325-3052-4ba0-bfd2-402f8594daaf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:27.598125 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a9325-3052-4ba0-bfd2-402f8594daaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:27.599515 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a9325-3052-4ba0-bfd2-402f8594daaf None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:27.603995 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 380/757] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Jul 27 16:13:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:27.610361 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4c41a-c3ec-49d4-bda5-90c18eb6509b None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:27.709648 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4c41a-c3ec-49d4-bda5-90c18eb6509b None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:27.744878 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ad055-4435-43ab-a9d4-d3e550101673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:27.745428 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ad055-4435-43ab-a9d4-d3e550101673 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:27.745711 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ad055-4435-43ab-a9d4-d3e550101673 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:27.745984 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ad055-4435-43ab-a9d4-d3e550101673 None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:27.746654 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ad055-4435-43ab-a9d4-d3e550101673 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:27.746959 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ad055-4435-43ab-a9d4-d3e550101673 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:27.748360 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ad055-4435-43ab-a9d4-d3e550101673 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:27.753635 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 378/758] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Jul 27 16:13:27 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:13:28.587462 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afa719-39fb-4886-8c32-846ba692fa4d None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:28.588076 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afa719-39fb-4886-8c32-846ba692fa4d None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:28.588076 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afa719-39fb-4886-8c32-846ba692fa4d None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:28.589349 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 381/759] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:13:28.594939 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20e991-abad-4271-a864-c7eefb561063 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:28.595336 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20e991-abad-4271-a864-c7eefb561063 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:28.595597 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20e991-abad-4271-a864-c7eefb561063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:28.614191 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-1b20e991-abad-4271-a864-c7eefb561063 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:28.615394 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-1b20e991-abad-4271-a864-c7eefb561063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:28.667727 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:28.683491 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 379/760] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:28 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:13:28.706743 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afa719-39fb-4886-8c32-846ba692fa4d None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:28.805657 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afa719-39fb-4886-8c32-846ba692fa4d None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:28.838961 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f314714-a4ee-47de-b667-706bc273f9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:28.839548 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f314714-a4ee-47de-b667-706bc273f9f2 None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:28.839837 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f314714-a4ee-47de-b667-706bc273f9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:28.840117 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f314714-a4ee-47de-b667-706bc273f9f2 None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:28.840827 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f314714-a4ee-47de-b667-706bc273f9f2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:28.842224 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f314714-a4ee-47de-b667-706bc273f9f2 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:28.847627 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:28.861650 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 382/761] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 16:13:28 2022] POST /identity/v3/services => generated 251 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:13:29.972455 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0696ba-b223-4973-b1b7-a600d9872eb7 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:29.972950 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0696ba-b223-4973-b1b7-a600d9872eb7 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:29.972950 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0696ba-b223-4973-b1b7-a600d9872eb7 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:29.974362 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 380/762] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:13:29.980141 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a8dbe-d18a-487c-bc9c-c0c2b9c19668 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:29.980141 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a8dbe-d18a-487c-bc9c-c0c2b9c19668 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:29.980674 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a8dbe-d18a-487c-bc9c-c0c2b9c19668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:29.999244 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-a71a8dbe-d18a-487c-bc9c-c0c2b9c19668 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:30.000477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-a71a8dbe-d18a-487c-bc9c-c0c2b9c19668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:30.072644 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 383/763] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:29 2022] POST /identity/v3/auth/tokens => generated 1497 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:13:30.095776 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0696ba-b223-4973-b1b7-a600d9872eb7 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:30.201847 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0696ba-b223-4973-b1b7-a600d9872eb7 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:30.236154 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80687677-c1d4-430b-ba93-1871bea67651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:30.236693 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80687677-c1d4-430b-ba93-1871bea67651 None admin] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:30.236977 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80687677-c1d4-430b-ba93-1871bea67651 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:30.237250 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80687677-c1d4-430b-ba93-1871bea67651 None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:30.237951 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80687677-c1d4-430b-ba93-1871bea67651 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:30.239305 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80687677-c1d4-430b-ba93-1871bea67651 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:30.254624 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 381/764] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 16:13:30 2022] POST /identity/v3/services => generated 269 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:13:31.079467 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b66541-0609-4f62-9ef6-de6255ef67fc None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:31.079983 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b66541-0609-4f62-9ef6-de6255ef67fc None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:31.080068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b66541-0609-4f62-9ef6-de6255ef67fc None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:31.081369 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 384/765] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:13:31.086706 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2e36c-79df-4a02-874a-32b5400f9e1a None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:31.087147 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2e36c-79df-4a02-874a-32b5400f9e1a None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:31.087393 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2e36c-79df-4a02-874a-32b5400f9e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:31.105462 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-30c2e36c-79df-4a02-874a-32b5400f9e1a None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:31.106634 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-30c2e36c-79df-4a02-874a-32b5400f9e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:31.149404 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:31.181478 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 382/766] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:31 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:13:31.206987 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b66541-0609-4f62-9ef6-de6255ef67fc None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:31.308223 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b66541-0609-4f62-9ef6-de6255ef67fc None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:31.331338 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:31.343135 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa22a6-1d07-40c1-8ce2-9f343dcfb1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:31.343810 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa22a6-1d07-40c1-8ce2-9f343dcfb1b6 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:31.344094 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa22a6-1d07-40c1-8ce2-9f343dcfb1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:31.344371 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa22a6-1d07-40c1-8ce2-9f343dcfb1b6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:31.345000 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa22a6-1d07-40c1-8ce2-9f343dcfb1b6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:31.346361 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa22a6-1d07-40c1-8ce2-9f343dcfb1b6 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:31.355099 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-ffaa22a6-1d07-40c1-8ce2-9f343dcfb1b6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 16:13:31.355099 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:31.355099 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:13:31.355099 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:13:31.355099 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:13:31.355099 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:13:31.355099 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:13:31.355099 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:31.355099 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 16:13:31.355099 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:31.355099 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:13:31.355099 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:31.355099 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:31.355099 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:31.355099 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:31.355099 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:31.355099 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:31.356288 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:31.356288 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:31.356288 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:31.356288 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:31.356288 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:31.356288 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:31.356288 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:13:31.356288 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:13:31.356288 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:13:31.356288 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:13:31.356288 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:31.356288 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:31.356288 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:31.356288 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:31.356288 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:31.356288 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:31.357662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:31.357662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:31.357662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:31.357662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:31.357662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:31.357662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:31.357662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:31.357662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:31.357662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:31.357662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:31.357662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:13:31.357662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:31.357662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 16:13:31.357662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:31.357662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 385/767] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 16:13:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:31.362672 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2e36c-79df-4a02-874a-32b5400f9e1a None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:31.464081 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2e36c-79df-4a02-874a-32b5400f9e1a None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:31.502234 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4fb11-e7f1-44bc-bff2-ebf3d785428b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:31.502856 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4fb11-e7f1-44bc-bff2-ebf3d785428b None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:31.503133 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4fb11-e7f1-44bc-bff2-ebf3d785428b None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:31.503446 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4fb11-e7f1-44bc-bff2-ebf3d785428b None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:31.504127 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4fb11-e7f1-44bc-bff2-ebf3d785428b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:31.504433 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4fb11-e7f1-44bc-bff2-ebf3d785428b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:31.505797 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4fb11-e7f1-44bc-bff2-ebf3d785428b None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:31.510654 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 383/768] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 16:13:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:31.516463 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa22a6-1d07-40c1-8ce2-9f343dcfb1b6 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:31.615770 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa22a6-1d07-40c1-8ce2-9f343dcfb1b6 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:31.647690 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ca9db-390b-4eb4-9faa-b6fd84b49cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:31.648305 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ca9db-390b-4eb4-9faa-b6fd84b49cd4 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:31.648590 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ca9db-390b-4eb4-9faa-b6fd84b49cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:31.648867 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ca9db-390b-4eb4-9faa-b6fd84b49cd4 None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:31.649541 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ca9db-390b-4eb4-9faa-b6fd84b49cd4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:31.649849 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ca9db-390b-4eb4-9faa-b6fd84b49cd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:31.651217 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ca9db-390b-4eb4-9faa-b6fd84b49cd4 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:31.656416 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 386/769] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 16:13:31 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:13:31.662236 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4fb11-e7f1-44bc-bff2-ebf3d785428b None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:31.707058 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:31.767844 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4fb11-e7f1-44bc-bff2-ebf3d785428b None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:31.802443 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598f0d3-95e0-4bbd-bcf2-9e9fa4581418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:31.803073 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598f0d3-95e0-4bbd-bcf2-9e9fa4581418 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:31.803357 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598f0d3-95e0-4bbd-bcf2-9e9fa4581418 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:31.803719 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598f0d3-95e0-4bbd-bcf2-9e9fa4581418 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:31.804431 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598f0d3-95e0-4bbd-bcf2-9e9fa4581418 None admin] RBAC: Adding query filter params (interface=public, service_id=58e603d71f75414591b4f89916ddf838, region_id=RegionOne) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:31.804743 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598f0d3-95e0-4bbd-bcf2-9e9fa4581418 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:31.806116 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598f0d3-95e0-4bbd-bcf2-9e9fa4581418 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:31.812223 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 384/770] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Jul 27 16:13:31 2022] GET /identity/v3/endpoints?service_id=58e603d71f75414591b4f89916ddf838&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:31.818270 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ca9db-390b-4eb4-9faa-b6fd84b49cd4 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:31.874858 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:31.925461 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ca9db-390b-4eb4-9faa-b6fd84b49cd4 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:31.958932 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39484330-6a0b-4769-b612-6996156217b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:31.959584 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39484330-6a0b-4769-b612-6996156217b2 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:31.959872 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39484330-6a0b-4769-b612-6996156217b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:31.960149 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39484330-6a0b-4769-b612-6996156217b2 None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:31.960794 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39484330-6a0b-4769-b612-6996156217b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:31.962166 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39484330-6a0b-4769-b612-6996156217b2 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:31.968084 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 387/771] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Jul 27 16:13:31 2022] GET /identity/v3/services => generated 1498 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:13:32.545786 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33dcce-bda1-4f7f-9083-b907dadcb0e7 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:32.546382 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33dcce-bda1-4f7f-9083-b907dadcb0e7 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:32.546531 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33dcce-bda1-4f7f-9083-b907dadcb0e7 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:32.547891 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 385/772] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:13:32.553243 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316367eb-0778-45b2-8711-96b0f0873535 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:32.553685 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316367eb-0778-45b2-8711-96b0f0873535 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:32.553792 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316367eb-0778-45b2-8711-96b0f0873535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:32.572607 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-316367eb-0778-45b2-8711-96b0f0873535 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:32.573781 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-316367eb-0778-45b2-8711-96b0f0873535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:32.638788 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 388/773] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:32 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 16:13:32.662615 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33dcce-bda1-4f7f-9083-b907dadcb0e7 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:32.765965 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33dcce-bda1-4f7f-9083-b907dadcb0e7 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:32.767549 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:32.802250 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76020b3c-58e5-4e9d-b5be-804a9fa21451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:32.802824 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76020b3c-58e5-4e9d-b5be-804a9fa21451 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:32.803111 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76020b3c-58e5-4e9d-b5be-804a9fa21451 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:32.803415 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76020b3c-58e5-4e9d-b5be-804a9fa21451 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:32.804037 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76020b3c-58e5-4e9d-b5be-804a9fa21451 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:32.805410 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76020b3c-58e5-4e9d-b5be-804a9fa21451 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:32.817573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-76020b3c-58e5-4e9d-b5be-804a9fa21451 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 16:13:32.817573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:32.817573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:13:32.817573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:13:32.817573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:13:32.817573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:13:32.817573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:13:32.817573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:32.817573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 16:13:32.817573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:32.817573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:13:32.817573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:32.817573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:32.817573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:32.817573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:32.817573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:32.818699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:32.818699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:32.818699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:32.818699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:32.818699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:32.818699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:32.818699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:32.818699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:13:32.818699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:13:32.818699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:13:32.818699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:13:32.818699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:32.818699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:32.818699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:32.818699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:32.818699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:32.819657 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:32.819657 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:32.819657 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:32.819657 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:32.819657 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:32.819657 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:32.819657 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:32.819657 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:32.819657 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:32.819657 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:32.819657 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:32.819657 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:13:32.819657 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:32.819657 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 16:13:32.819657 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:32.823716 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 386/774] 10.222.0.65 () {56 vars in 1132 bytes} [Wed Jul 27 16:13:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:32.824783 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316367eb-0778-45b2-8711-96b0f0873535 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:32.869687 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:32.927710 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316367eb-0778-45b2-8711-96b0f0873535 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:32.961489 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee8992-1871-4b2e-982f-d5173c7921af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:32.962103 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee8992-1871-4b2e-982f-d5173c7921af None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:32.962385 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee8992-1871-4b2e-982f-d5173c7921af None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:32.962661 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee8992-1871-4b2e-982f-d5173c7921af None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:32.963338 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee8992-1871-4b2e-982f-d5173c7921af None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:32.963672 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee8992-1871-4b2e-982f-d5173c7921af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:32.965043 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee8992-1871-4b2e-982f-d5173c7921af None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:32.969741 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 389/775] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Jul 27 16:13:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:32.975426 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76020b3c-58e5-4e9d-b5be-804a9fa21451 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:33.074976 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76020b3c-58e5-4e9d-b5be-804a9fa21451 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:33.108171 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa5570-9270-4e7b-bc24-dd41aab574a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:33.108810 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa5570-9270-4e7b-bc24-dd41aab574a8 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:33.109820 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa5570-9270-4e7b-bc24-dd41aab574a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:33.110017 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa5570-9270-4e7b-bc24-dd41aab574a8 None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:33.110717 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa5570-9270-4e7b-bc24-dd41aab574a8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:33.111028 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa5570-9270-4e7b-bc24-dd41aab574a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:33.112486 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa5570-9270-4e7b-bc24-dd41aab574a8 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:33.118137 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 387/776] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Jul 27 16:13:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:33.124297 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee8992-1871-4b2e-982f-d5173c7921af None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:33.226668 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee8992-1871-4b2e-982f-d5173c7921af None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:33.236670 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:33.266326 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784cd1d-84fc-42e8-ace3-cdf2bcc77d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:33.267295 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784cd1d-84fc-42e8-ace3-cdf2bcc77d2f None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:33.267804 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784cd1d-84fc-42e8-ace3-cdf2bcc77d2f None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:33.268266 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784cd1d-84fc-42e8-ace3-cdf2bcc77d2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:33.269169 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784cd1d-84fc-42e8-ace3-cdf2bcc77d2f None admin] RBAC: Adding query filter params (interface=public, service_id=7500e0e9095e45be937c76aeace7b609, region_id=RegionOne) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:33.269487 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784cd1d-84fc-42e8-ace3-cdf2bcc77d2f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:33.270862 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784cd1d-84fc-42e8-ace3-cdf2bcc77d2f None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:33.276003 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 390/777] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Jul 27 16:13:33 2022] GET /identity/v3/endpoints?service_id=7500e0e9095e45be937c76aeace7b609&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:33.281660 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa5570-9270-4e7b-bc24-dd41aab574a8 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:33.313042 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:33.382290 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa5570-9270-4e7b-bc24-dd41aab574a8 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:33.415124 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b1ebe-256e-437f-9f6f-149d77e92fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:33.416022 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b1ebe-256e-437f-9f6f-149d77e92fc0 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:33.416306 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b1ebe-256e-437f-9f6f-149d77e92fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:33.416582 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b1ebe-256e-437f-9f6f-149d77e92fc0 None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:33.417228 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b1ebe-256e-437f-9f6f-149d77e92fc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:33.418588 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b1ebe-256e-437f-9f6f-149d77e92fc0 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:33.425043 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 388/778] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Jul 27 16:13:33 2022] GET /identity/v3/services => generated 1498 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:13:34.217604 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8337b-f1f6-4d77-aae4-72055410eee9 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:34.218129 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8337b-f1f6-4d77-aae4-72055410eee9 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:34.218236 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8337b-f1f6-4d77-aae4-72055410eee9 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:34.219568 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 391/779] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:13:34.224891 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c99587-ef00-4b06-a16e-57a9f8381182 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:34.225469 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c99587-ef00-4b06-a16e-57a9f8381182 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:34.225469 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c99587-ef00-4b06-a16e-57a9f8381182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:34.244131 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-f1c99587-ef00-4b06-a16e-57a9f8381182 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:34.245324 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-f1c99587-ef00-4b06-a16e-57a9f8381182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:34.313132 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 389/780] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:34 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 16:13:34.336951 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8337b-f1f6-4d77-aae4-72055410eee9 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:34.441430 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8337b-f1f6-4d77-aae4-72055410eee9 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:34.476204 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf34e24-a5f3-4224-baf1-faa0814aad52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:34.476772 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf34e24-a5f3-4224-baf1-faa0814aad52 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:34.477055 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf34e24-a5f3-4224-baf1-faa0814aad52 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:34.477330 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf34e24-a5f3-4224-baf1-faa0814aad52 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:34.478007 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf34e24-a5f3-4224-baf1-faa0814aad52 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:34.479331 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf34e24-a5f3-4224-baf1-faa0814aad52 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:34.488645 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-ddf34e24-a5f3-4224-baf1-faa0814aad52 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 16:13:34.488645 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:34.488645 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:13:34.488645 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:13:34.488645 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:13:34.488645 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:13:34.488645 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:13:34.488645 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:34.488645 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 16:13:34.488645 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:34.488645 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:13:34.488645 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:34.488645 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:34.488645 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:34.488645 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:34.488645 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:34.488645 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:34.489699 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:34.489699 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:34.489699 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:34.489699 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:34.489699 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:34.489699 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:34.489699 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:13:34.489699 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:13:34.489699 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:13:34.489699 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:13:34.489699 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:34.489699 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:34.489699 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:34.489699 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:34.489699 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:34.489699 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:34.490898 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:34.490898 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:34.490898 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:34.490898 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:34.490898 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:34.490898 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:34.490898 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:34.490898 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:34.490898 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:34.490898 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:34.490898 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:13:34.490898 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:34.490898 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 16:13:34.490898 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:34.490898 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 392/781] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 16:13:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:34.495774 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c99587-ef00-4b06-a16e-57a9f8381182 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:34.520614 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:34.598707 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c99587-ef00-4b06-a16e-57a9f8381182 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:34.632602 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0b541-515c-4b5c-b90f-3228c71a7bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:34.633218 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0b541-515c-4b5c-b90f-3228c71a7bed None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:34.633497 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0b541-515c-4b5c-b90f-3228c71a7bed None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:34.633767 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0b541-515c-4b5c-b90f-3228c71a7bed None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:34.634437 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0b541-515c-4b5c-b90f-3228c71a7bed None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:34.634734 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0b541-515c-4b5c-b90f-3228c71a7bed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:34.636146 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0b541-515c-4b5c-b90f-3228c71a7bed None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:34.640768 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 390/782] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 16:13:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:34.646402 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf34e24-a5f3-4224-baf1-faa0814aad52 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:34.685659 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:34.748591 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf34e24-a5f3-4224-baf1-faa0814aad52 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:34.780177 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af494c8e-9e8e-4d8c-bee3-70cb874529f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:34.780789 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af494c8e-9e8e-4d8c-bee3-70cb874529f6 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:34.781644 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af494c8e-9e8e-4d8c-bee3-70cb874529f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:34.781920 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af494c8e-9e8e-4d8c-bee3-70cb874529f6 None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:34.782590 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af494c8e-9e8e-4d8c-bee3-70cb874529f6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:34.782893 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af494c8e-9e8e-4d8c-bee3-70cb874529f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:34.784289 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af494c8e-9e8e-4d8c-bee3-70cb874529f6 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:34.788953 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 393/783] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 16:13:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:34.794793 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0b541-515c-4b5c-b90f-3228c71a7bed None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:34.879408 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:34.892066 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0b541-515c-4b5c-b90f-3228c71a7bed None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:34.926664 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0360b-ca19-4fb0-9e03-b932e18af4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:34.927281 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0360b-ca19-4fb0-9e03-b932e18af4e5 None admin] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:34.927586 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0360b-ca19-4fb0-9e03-b932e18af4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:34.927857 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0360b-ca19-4fb0-9e03-b932e18af4e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:34.928574 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0360b-ca19-4fb0-9e03-b932e18af4e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:34.929923 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0360b-ca19-4fb0-9e03-b932e18af4e5 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:34.951543 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 391/784] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 16:13:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:13:35.670622 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa426f-fa3c-4976-93e9-4dfb2c045971 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:35.671505 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa426f-fa3c-4976-93e9-4dfb2c045971 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:35.671800 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa426f-fa3c-4976-93e9-4dfb2c045971 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:35.673157 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 394/785] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:13:35.678565 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c54e01-01be-425a-80ec-3a50346a64aa None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:35.678998 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c54e01-01be-425a-80ec-3a50346a64aa None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:35.679135 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c54e01-01be-425a-80ec-3a50346a64aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:35.697129 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-a5c54e01-01be-425a-80ec-3a50346a64aa None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:35.698299 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-a5c54e01-01be-425a-80ec-3a50346a64aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:35.771050 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 392/786] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:35 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:13:35.795037 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa426f-fa3c-4976-93e9-4dfb2c045971 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:35.892143 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:35.896075 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa426f-fa3c-4976-93e9-4dfb2c045971 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:35.933331 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bf1d6-b090-4320-9ef2-4222262068e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:35.933894 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bf1d6-b090-4320-9ef2-4222262068e9 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:35.934178 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bf1d6-b090-4320-9ef2-4222262068e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:35.934454 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bf1d6-b090-4320-9ef2-4222262068e9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:35.935079 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110bf1d6-b090-4320-9ef2-4222262068e9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:35.936484 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110bf1d6-b090-4320-9ef2-4222262068e9 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:35.945198 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-110bf1d6-b090-4320-9ef2-4222262068e9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 16:13:35.945198 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:35.945198 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:13:35.945198 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:13:35.945198 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:13:35.945198 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:13:35.945198 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:13:35.945198 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:35.945198 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 16:13:35.945198 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:35.945198 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:13:35.945198 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:35.945198 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:35.945198 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:35.945198 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:35.945198 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:35.946121 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:35.946121 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:35.946121 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:35.946121 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:35.946121 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:35.946121 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:35.946121 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:35.946121 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:13:35.946121 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:13:35.946121 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:13:35.946121 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:13:35.946121 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:35.946121 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:35.946121 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:35.946121 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:35.946121 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:35.947155 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:35.947155 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:35.947155 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:35.947155 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:35.947155 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:35.947155 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:35.947155 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:35.947155 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:35.947155 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:35.947155 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:35.947155 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:35.947155 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:13:35.947155 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:35.947155 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 16:13:35.947155 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:35.947155 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 395/787] 10.222.0.65 () {56 vars in 1132 bytes} [Wed Jul 27 16:13:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:35.952364 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c54e01-01be-425a-80ec-3a50346a64aa None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:36.019608 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:36.056766 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c54e01-01be-425a-80ec-3a50346a64aa None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:36.096031 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b31db7-4703-40bb-afea-cc1f63339084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:36.096651 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b31db7-4703-40bb-afea-cc1f63339084 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:36.096928 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b31db7-4703-40bb-afea-cc1f63339084 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:36.097197 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b31db7-4703-40bb-afea-cc1f63339084 None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:36.097866 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b31db7-4703-40bb-afea-cc1f63339084 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:36.098167 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b31db7-4703-40bb-afea-cc1f63339084 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:36.099561 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b31db7-4703-40bb-afea-cc1f63339084 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:36.104474 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 393/788] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Jul 27 16:13:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:36.110401 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bf1d6-b090-4320-9ef2-4222262068e9 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:36.217154 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bf1d6-b090-4320-9ef2-4222262068e9 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:36.255647 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224b246-8548-442b-9436-2e37df380d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:36.256263 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224b246-8548-442b-9436-2e37df380d27 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:36.256545 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224b246-8548-442b-9436-2e37df380d27 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:36.256817 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224b246-8548-442b-9436-2e37df380d27 None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:36.257522 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224b246-8548-442b-9436-2e37df380d27 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:36.257821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224b246-8548-442b-9436-2e37df380d27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:36.259190 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224b246-8548-442b-9436-2e37df380d27 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:36.264273 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 396/789] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Jul 27 16:13:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:36.269974 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b31db7-4703-40bb-afea-cc1f63339084 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:36.367355 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b31db7-4703-40bb-afea-cc1f63339084 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:36.400722 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446aab26-b8bd-4fe3-94df-23115a646724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:36.401331 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446aab26-b8bd-4fe3-94df-23115a646724 None admin] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:36.401613 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446aab26-b8bd-4fe3-94df-23115a646724 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:36.401886 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446aab26-b8bd-4fe3-94df-23115a646724 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:36.402589 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446aab26-b8bd-4fe3-94df-23115a646724 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:36.403972 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446aab26-b8bd-4fe3-94df-23115a646724 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:36.408966 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:36.426607 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 394/790] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 16:13:36 2022] POST /identity/v3/endpoints => generated 347 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:13:37.217912 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5dbb5f-bebd-4156-ae97-718257fbd371 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:37.218506 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5dbb5f-bebd-4156-ae97-718257fbd371 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:37.218506 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5dbb5f-bebd-4156-ae97-718257fbd371 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:37.220003 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 397/791] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:13:37.225411 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2872c0-d6e4-4a34-b61f-45a99bf4ba28 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:37.225860 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2872c0-d6e4-4a34-b61f-45a99bf4ba28 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:37.225955 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2872c0-d6e4-4a34-b61f-45a99bf4ba28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:37.244203 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-ee2872c0-d6e4-4a34-b61f-45a99bf4ba28 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:37.245394 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-ee2872c0-d6e4-4a34-b61f-45a99bf4ba28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:37.317002 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 395/792] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:37 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:13:37.340970 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5dbb5f-bebd-4156-ae97-718257fbd371 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:37.368656 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:37.442938 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5dbb5f-bebd-4156-ae97-718257fbd371 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:37.477909 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce501e-7b1f-47fc-ba75-4e83561e8f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:37.478446 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce501e-7b1f-47fc-ba75-4e83561e8f6f None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:37.478725 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce501e-7b1f-47fc-ba75-4e83561e8f6f None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:37.478997 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce501e-7b1f-47fc-ba75-4e83561e8f6f None admin] PATH_INFO: `/v3/projects` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:37.479705 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce501e-7b1f-47fc-ba75-4e83561e8f6f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:37.481134 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce501e-7b1f-47fc-ba75-4e83561e8f6f None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:37.483769 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: WARNING keystone.server.flask.common [None req-c9ce501e-7b1f-47fc-ba75-4e83561e8f6f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 27 16:13:37.502396 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.sql.core [None req-c9ce501e-7b1f-47fc-ba75-4e83561e8f6f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 16:13:37.502396 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 27 16:13:37.502396 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [parameters: {'id': 'ba9188de69ea42aab96476c538f66f50', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 27 16:13:37.502396 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87085) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 16:13:37.519219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-c9ce501e-7b1f-47fc-ba75-4e83561e8f6f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ba9188de69ea42aab96476c538f66f50.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ba9188de69ea42aab96476c538f66f50. Jul 27 16:13:37.519219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:37.519219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 16:13:37.519219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 16:13:37.519219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 16:13:37.519219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 16:13:37.519219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 16:13:37.519219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 16:13:37.519219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 16:13:37.519219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application conn.query(q) Jul 27 16:13:37.519219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 16:13:37.519219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 16:13:37.519219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 16:13:37.520302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application result.read() Jul 27 16:13:37.520302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 16:13:37.520302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 16:13:37.520302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 16:13:37.520302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 16:13:37.520302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 16:13:37.520302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 16:13:37.520302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 16:13:37.520302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 16:13:37.520302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 16:13:37.520302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:37.520302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 16:13:37.520302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:37.520302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:37.520302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 16:13:37.520302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 16:13:37.520302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 27 16:13:37.520302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 27 16:13:37.521508 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 16:13:37.521508 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application next(self.gen) Jul 27 16:13:37.521508 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 16:13:37.521508 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application yield resource Jul 27 16:13:37.521508 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 16:13:37.521508 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application next(self.gen) Jul 27 16:13:37.521508 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 16:13:37.521508 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 16:13:37.521508 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 16:13:37.521508 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 16:13:37.521508 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 16:13:37.521508 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise self.value Jul 27 16:13:37.521508 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 16:13:37.521508 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 16:13:37.521508 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 16:13:37.521508 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application session.commit() Jul 27 16:13:37.521508 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 16:13:37.522942 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 16:13:37.522942 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 16:13:37.522942 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 16:13:37.522942 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 16:13:37.522942 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self.session.flush() Jul 27 16:13:37.522942 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 16:13:37.522942 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 16:13:37.522942 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 16:13:37.522942 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 16:13:37.522942 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 16:13:37.522942 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application compat.raise_( Jul 27 16:13:37.522942 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 16:13:37.522942 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception Jul 27 16:13:37.522942 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 16:13:37.522942 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 16:13:37.522942 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 16:13:37.522942 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 16:13:37.524158 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 16:13:37.524158 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 16:13:37.524158 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 16:13:37.524158 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 16:13:37.524158 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 27 16:13:37.524158 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 27 16:13:37.524158 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 16:13:37.524158 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 16:13:37.524158 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 16:13:37.524158 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 16:13:37.524158 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 16:13:37.524158 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 16:13:37.524158 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 16:13:37.524158 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 16:13:37.524158 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 16:13:37.525335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 16:13:37.525335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 16:13:37.525335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception Jul 27 16:13:37.525335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 16:13:37.525335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 16:13:37.525335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 16:13:37.525335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 16:13:37.525335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 16:13:37.525335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 16:13:37.525335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 16:13:37.525335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application conn.query(q) Jul 27 16:13:37.525335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 16:13:37.525335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 16:13:37.525335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 16:13:37.525335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application result.read() Jul 27 16:13:37.525335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 16:13:37.525335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 16:13:37.526744 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 16:13:37.526744 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 16:13:37.526744 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 16:13:37.526744 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 16:13:37.526744 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 16:13:37.526744 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 16:13:37.526744 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 16:13:37.526744 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 27 16:13:37.526744 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [parameters: {'id': 'ba9188de69ea42aab96476c538f66f50', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 27 16:13:37.526744 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 16:13:37.526744 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:37.526744 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:13:37.526744 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:37.526744 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:37.526744 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 27 16:13:37.527888 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 27 16:13:37.527888 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 16:13:37.527888 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 16:13:37.527888 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 27 16:13:37.527888 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:37.527888 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:13:37.527888 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:37.527888 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:37.527888 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:37.527888 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:37.527888 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:37.527888 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:37.527888 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:37.527888 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:37.527888 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:37.527888 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:37.527888 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:37.528985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:37.528985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 27 16:13:37.528985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 27 16:13:37.528985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:37.528985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:37.528985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 27 16:13:37.528985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 27 16:13:37.528985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ba9188de69ea42aab96476c538f66f50. Jul 27 16:13:37.528985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:37.528985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 398/793] 10.222.0.65 () {60 vars in 1140 bytes} [Wed Jul 27 16:13:37 2022] POST /identity/v3/projects => generated 262 bytes in 180 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:37.529561 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2872c0-d6e4-4a34-b61f-45a99bf4ba28 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:37.630197 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2872c0-d6e4-4a34-b61f-45a99bf4ba28 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:37.648113 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:37.668296 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37878c61-2561-4984-94be-de621cc74cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:37.668949 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37878c61-2561-4984-94be-de621cc74cad None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:37.669233 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37878c61-2561-4984-94be-de621cc74cad None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:37.669509 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37878c61-2561-4984-94be-de621cc74cad None admin] PATH_INFO: `/v3/projects/service` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:37.679561 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37878c61-2561-4984-94be-de621cc74cad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:37.681017 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37878c61-2561-4984-94be-de621cc74cad None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:37.692456 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-37878c61-2561-4984-94be-de621cc74cad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:13:37.692456 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:37.692456 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:37.692456 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:37.692456 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:37.692456 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:37.692456 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:37.692456 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:37.692456 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:37.692456 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:37.692456 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:37.692456 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:37.692456 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:13:37.692456 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:13:37.692456 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:13:37.693484 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:13:37.693484 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:37.693484 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:37.693484 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:37.693484 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:37.693484 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:37.693484 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:37.693484 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:37.693484 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:37.693484 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:37.693484 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:37.693484 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:37.693484 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:37.693484 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:37.693484 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:37.693484 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:37.693484 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:37.694419 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:13:37.694419 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:13:37.694419 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:13:37.694419 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:13:37.694419 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:13:37.694419 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:13:37.694419 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:13:37.694419 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:37.695515 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 396/794] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:13:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:37.699672 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce501e-7b1f-47fc-ba75-4e83561e8f6f None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:37.791527 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:37.811025 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce501e-7b1f-47fc-ba75-4e83561e8f6f None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:37.844993 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c6600-a5dd-4d79-a455-60014c0571ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:37.845614 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c6600-a5dd-4d79-a455-60014c0571ba None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:37.845901 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c6600-a5dd-4d79-a455-60014c0571ba None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:37.846178 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c6600-a5dd-4d79-a455-60014c0571ba None admin] PATH_INFO: `/v3/projects` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:37.846895 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c6600-a5dd-4d79-a455-60014c0571ba None admin] RBAC: Adding query filter params (name=service) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:37.847204 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c6600-a5dd-4d79-a455-60014c0571ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:37.849354 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c6600-a5dd-4d79-a455-60014c0571ba None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:37.869327 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 399/795] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 16:13:37 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:38.680871 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538b543-cef8-4dae-8753-c7e89e254683 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:38.681374 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538b543-cef8-4dae-8753-c7e89e254683 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:38.681492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538b543-cef8-4dae-8753-c7e89e254683 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:38.682808 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 397/796] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:13:38.688223 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77cf39-15e5-456e-a936-880db8d84f17 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:38.688618 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77cf39-15e5-456e-a936-880db8d84f17 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:38.688795 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77cf39-15e5-456e-a936-880db8d84f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:38.707679 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-4d77cf39-15e5-456e-a936-880db8d84f17 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:38.709182 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-4d77cf39-15e5-456e-a936-880db8d84f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:38.775180 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 400/797] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:38 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:13:38.799500 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538b543-cef8-4dae-8753-c7e89e254683 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:38.900526 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538b543-cef8-4dae-8753-c7e89e254683 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:38.935901 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec913c9c-ec6f-4e81-9ffb-d055c9db85ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:38.937155 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec913c9c-ec6f-4e81-9ffb-d055c9db85ca None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:38.937155 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec913c9c-ec6f-4e81-9ffb-d055c9db85ca None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:38.937155 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec913c9c-ec6f-4e81-9ffb-d055c9db85ca None admin] PATH_INFO: `/v3/services/compute` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:38.937671 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec913c9c-ec6f-4e81-9ffb-d055c9db85ca None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:38.939027 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec913c9c-ec6f-4e81-9ffb-d055c9db85ca None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:38.948092 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-ec913c9c-ec6f-4e81-9ffb-d055c9db85ca None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 16:13:38.948092 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:38.948092 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:13:38.948092 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:13:38.948092 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:13:38.948092 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:13:38.948092 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:13:38.948092 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:38.948092 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 16:13:38.948092 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:38.948092 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:13:38.948092 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:38.948092 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:38.948092 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:38.948092 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:38.948092 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:38.948092 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:38.949119 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:38.949119 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:38.949119 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:38.949119 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:38.949119 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:38.949119 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:38.949119 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:13:38.949119 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:13:38.949119 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:13:38.949119 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:13:38.949119 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:38.949119 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:38.949119 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:38.949119 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:38.949119 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:38.949119 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:38.950307 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:38.950307 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:38.950307 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:38.950307 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:38.950307 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:38.950307 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:38.950307 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:38.950307 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:38.950307 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:38.950307 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:38.950307 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:13:38.950307 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:38.950307 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 16:13:38.950307 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:38.950307 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 398/798] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:13:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:38.955728 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77cf39-15e5-456e-a936-880db8d84f17 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:39.031791 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:39.059113 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77cf39-15e5-456e-a936-880db8d84f17 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:39.092838 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f5343-97f5-4542-945b-61a32f6c43c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:39.093453 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f5343-97f5-4542-945b-61a32f6c43c5 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:39.093730 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f5343-97f5-4542-945b-61a32f6c43c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:39.094000 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f5343-97f5-4542-945b-61a32f6c43c5 None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:39.094672 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f5343-97f5-4542-945b-61a32f6c43c5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:39.094976 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f5343-97f5-4542-945b-61a32f6c43c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:39.096387 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f5343-97f5-4542-945b-61a32f6c43c5 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:39.101136 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 401/799] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 16:13:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:39.107401 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec913c9c-ec6f-4e81-9ffb-d055c9db85ca None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:39.148698 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:39.208153 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec913c9c-ec6f-4e81-9ffb-d055c9db85ca None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:39.240601 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e086a-4590-47ab-b236-0754c32b30d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:39.241214 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e086a-4590-47ab-b236-0754c32b30d8 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:39.241496 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e086a-4590-47ab-b236-0754c32b30d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:39.241771 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e086a-4590-47ab-b236-0754c32b30d8 None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:39.242432 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e086a-4590-47ab-b236-0754c32b30d8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:39.242799 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e086a-4590-47ab-b236-0754c32b30d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:39.244180 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e086a-4590-47ab-b236-0754c32b30d8 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:39.248540 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 399/800] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 16:13:39 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:40.135266 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8285a8c-012f-49e8-bf33-da695012a70e None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:40.135834 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8285a8c-012f-49e8-bf33-da695012a70e None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:40.135834 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8285a8c-012f-49e8-bf33-da695012a70e None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:40.137200 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 402/801] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:13:40.142895 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72549d2d-7a4f-4d36-a271-3de3e2c1b21f None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:40.143318 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72549d2d-7a4f-4d36-a271-3de3e2c1b21f None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:40.143507 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72549d2d-7a4f-4d36-a271-3de3e2c1b21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:40.161214 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-72549d2d-7a4f-4d36-a271-3de3e2c1b21f None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:40.162436 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-72549d2d-7a4f-4d36-a271-3de3e2c1b21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:40.227889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 400/802] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:40 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 16:13:40.256519 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8285a8c-012f-49e8-bf33-da695012a70e None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:40.358709 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8285a8c-012f-49e8-bf33-da695012a70e None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:40.395037 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67226cf-19a7-4c54-9a88-3f96bd36eca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:40.395683 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67226cf-19a7-4c54-9a88-3f96bd36eca3 None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:40.395880 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67226cf-19a7-4c54-9a88-3f96bd36eca3 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:40.396155 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67226cf-19a7-4c54-9a88-3f96bd36eca3 None admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:40.396826 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67226cf-19a7-4c54-9a88-3f96bd36eca3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:40.398248 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67226cf-19a7-4c54-9a88-3f96bd36eca3 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:40.409170 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:40.412688 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.sql.core [None req-c67226cf-19a7-4c54-9a88-3f96bd36eca3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 16:13:40.412688 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 27 16:13:40.412688 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [parameters: {'user_id': '3f9e6a08818542328c48f433ca0b494e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 27 16:13:40.412688 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87085) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 16:13:40.422504 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-c67226cf-19a7-4c54-9a88-3f96bd36eca3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 27 16:13:40.422504 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:40.422504 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 16:13:40.422504 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 16:13:40.422504 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 16:13:40.422504 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 16:13:40.422504 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 16:13:40.422504 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 16:13:40.422504 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 16:13:40.422504 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application conn.query(q) Jul 27 16:13:40.422504 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 16:13:40.422504 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 16:13:40.422504 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 16:13:40.422504 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application result.read() Jul 27 16:13:40.422504 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 16:13:40.423476 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 16:13:40.423476 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 16:13:40.423476 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 16:13:40.423476 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 16:13:40.423476 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 16:13:40.423476 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 16:13:40.423476 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 16:13:40.423476 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 16:13:40.423476 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:40.423476 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 16:13:40.423476 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:40.423476 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:40.423476 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 16:13:40.423476 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 16:13:40.423476 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 27 16:13:40.423476 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 27 16:13:40.423476 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 16:13:40.423476 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application next(self.gen) Jul 27 16:13:40.424449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 16:13:40.424449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application yield resource Jul 27 16:13:40.424449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 16:13:40.424449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application next(self.gen) Jul 27 16:13:40.424449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 16:13:40.424449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 16:13:40.424449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 16:13:40.424449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 16:13:40.424449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 16:13:40.424449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise self.value Jul 27 16:13:40.424449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 16:13:40.424449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 16:13:40.424449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 16:13:40.424449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application session.commit() Jul 27 16:13:40.424449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 16:13:40.424449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 16:13:40.424449 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 16:13:40.425335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 16:13:40.425335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 16:13:40.425335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self.session.flush() Jul 27 16:13:40.425335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 16:13:40.425335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 16:13:40.425335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 16:13:40.425335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 16:13:40.425335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 16:13:40.425335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application compat.raise_( Jul 27 16:13:40.425335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 16:13:40.425335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception Jul 27 16:13:40.425335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 16:13:40.425335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 16:13:40.425335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 16:13:40.425335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 16:13:40.425335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 16:13:40.425335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 16:13:40.426228 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 16:13:40.426228 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 16:13:40.426228 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 27 16:13:40.426228 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 27 16:13:40.426228 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 16:13:40.426228 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 16:13:40.426228 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 16:13:40.426228 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 16:13:40.426228 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 16:13:40.426228 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 16:13:40.426228 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 16:13:40.426228 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 16:13:40.426228 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 16:13:40.426228 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 16:13:40.426228 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 16:13:40.426228 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception Jul 27 16:13:40.427065 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 16:13:40.427065 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 16:13:40.427065 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 16:13:40.427065 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 16:13:40.427065 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 16:13:40.427065 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 16:13:40.427065 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 16:13:40.427065 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application conn.query(q) Jul 27 16:13:40.427065 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 16:13:40.427065 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 16:13:40.427065 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 16:13:40.427065 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application result.read() Jul 27 16:13:40.427065 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 16:13:40.427065 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 16:13:40.427065 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 16:13:40.427065 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 16:13:40.427940 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 16:13:40.427940 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 16:13:40.427940 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 16:13:40.427940 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 16:13:40.427940 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 16:13:40.427940 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 27 16:13:40.427940 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [parameters: {'user_id': '3f9e6a08818542328c48f433ca0b494e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 27 16:13:40.427940 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 16:13:40.427940 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:40.427940 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:13:40.427940 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:40.427940 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:40.427940 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:40.427940 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:40.427940 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:40.428728 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:40.428728 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:40.428728 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:40.428728 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:40.428728 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:40.428728 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:40.428728 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:40.428728 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 27 16:13:40.428728 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 27 16:13:40.428728 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:40.428728 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:40.428728 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:13:40.428728 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:13:40.428728 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:13:40.428728 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:13:40.428728 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 27 16:13:40.428728 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 27 16:13:40.429659 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 27 16:13:40.429659 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 27 16:13:40.429659 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 16:13:40.429659 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 16:13:40.429659 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 27 16:13:40.429659 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:40.429659 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 403/803] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Jul 27 16:13:40 2022] POST /identity/v3/users => generated 160 bytes in 169 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:40.430065 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72549d2d-7a4f-4d36-a271-3de3e2c1b21f None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:40.464796 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:40.535506 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72549d2d-7a4f-4d36-a271-3de3e2c1b21f None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:40.568869 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e44ba-e9ae-44fa-b278-c3823729de6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:40.569517 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e44ba-e9ae-44fa-b278-c3823729de6a None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:40.569801 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e44ba-e9ae-44fa-b278-c3823729de6a None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:40.570074 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e44ba-e9ae-44fa-b278-c3823729de6a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:40.577477 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e44ba-e9ae-44fa-b278-c3823729de6a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:40.578952 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e44ba-e9ae-44fa-b278-c3823729de6a None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:40.590357 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-026e44ba-e9ae-44fa-b278-c3823729de6a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 16:13:40.590357 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:40.590357 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:40.590357 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:40.590357 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:40.590357 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:40.590357 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:40.590357 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:40.590357 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:40.590357 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:40.590357 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:40.590357 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:40.590357 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:13:40.590357 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:13:40.590357 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:13:40.590357 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:13:40.591492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:40.591492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:40.591492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:13:40.591492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:13:40.591492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:13:40.591492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:13:40.591492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:40.591492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:40.591492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:40.591492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:40.591492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:40.591492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:40.591492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:40.591492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:40.591492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:40.591492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:40.591492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:40.591492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:40.592535 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:40.592535 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:40.592535 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:13:40.592535 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:13:40.592535 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:13:40.592535 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:13:40.592535 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:13:40.592535 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:13:40.592535 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 16:13:40.592535 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:40.592535 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 401/804] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:13:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:40.598381 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67226cf-19a7-4c54-9a88-3f96bd36eca3 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:40.697592 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67226cf-19a7-4c54-9a88-3f96bd36eca3 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:40.731120 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced6736-19ed-4cac-98de-b37f713b5d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:40.731858 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced6736-19ed-4cac-98de-b37f713b5d4f None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:40.732160 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced6736-19ed-4cac-98de-b37f713b5d4f None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:40.732437 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced6736-19ed-4cac-98de-b37f713b5d4f None admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:40.733404 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced6736-19ed-4cac-98de-b37f713b5d4f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:40.733743 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced6736-19ed-4cac-98de-b37f713b5d4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:40.736221 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced6736-19ed-4cac-98de-b37f713b5d4f None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:40.775564 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 404/805] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 16:13:40 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:41.482986 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a44b65-c908-4a42-b5e1-9da972a5e6b4 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:41.483550 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a44b65-c908-4a42-b5e1-9da972a5e6b4 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:41.483662 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a44b65-c908-4a42-b5e1-9da972a5e6b4 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:41.485526 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 402/806] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:13:41.490865 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd27aa4-8b3d-42ab-92ad-44017d72e9c1 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:41.491287 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd27aa4-8b3d-42ab-92ad-44017d72e9c1 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:41.491438 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd27aa4-8b3d-42ab-92ad-44017d72e9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:41.509524 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-cfd27aa4-8b3d-42ab-92ad-44017d72e9c1 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:41.511051 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-cfd27aa4-8b3d-42ab-92ad-44017d72e9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:41.562554 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:41.578514 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 405/807] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:41 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:13:41.602891 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a44b65-c908-4a42-b5e1-9da972a5e6b4 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:41.701567 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:41.707255 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a44b65-c908-4a42-b5e1-9da972a5e6b4 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:41.741490 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b51e0-1bae-4604-96aa-dff30df51898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:41.742021 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b51e0-1bae-4604-96aa-dff30df51898 None admin] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:41.742301 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b51e0-1bae-4604-96aa-dff30df51898 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:41.742576 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b51e0-1bae-4604-96aa-dff30df51898 None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:41.743269 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b51e0-1bae-4604-96aa-dff30df51898 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:41.744669 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b51e0-1bae-4604-96aa-dff30df51898 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:41.758166 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 403/808] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 16:13:41 2022] POST /identity/v3/services => generated 242 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:13:43.978846 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138a885-b5bb-4df6-ab14-e451d435196b None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:43.979406 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138a885-b5bb-4df6-ab14-e451d435196b None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:43.979406 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138a885-b5bb-4df6-ab14-e451d435196b None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:43.980711 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 406/809] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:13:43.985985 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e49a2e-bca0-4926-88c3-7607a8c1bce0 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:43.986389 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e49a2e-bca0-4926-88c3-7607a8c1bce0 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:43.986544 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e49a2e-bca0-4926-88c3-7607a8c1bce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:44.004213 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-a1e49a2e-bca0-4926-88c3-7607a8c1bce0 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:44.005388 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-a1e49a2e-bca0-4926-88c3-7607a8c1bce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:44.075716 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 404/810] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:43 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:13:44.100176 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138a885-b5bb-4df6-ab14-e451d435196b None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:44.197687 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138a885-b5bb-4df6-ab14-e451d435196b None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:44.232706 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f2aa6-dfdf-424e-a485-3a22a574d46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:44.233270 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f2aa6-dfdf-424e-a485-3a22a574d46e None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:44.233557 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f2aa6-dfdf-424e-a485-3a22a574d46e None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:44.233836 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f2aa6-dfdf-424e-a485-3a22a574d46e None admin] PATH_INFO: `/v3/services/compute` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:44.234510 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f2aa6-dfdf-424e-a485-3a22a574d46e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:44.235948 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f2aa6-dfdf-424e-a485-3a22a574d46e None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:44.244647 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-405f2aa6-dfdf-424e-a485-3a22a574d46e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 16:13:44.244647 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:44.244647 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:13:44.244647 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:13:44.244647 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:13:44.244647 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:13:44.244647 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:13:44.244647 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:44.244647 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 16:13:44.244647 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:44.244647 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:13:44.244647 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:44.244647 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:44.244647 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:44.244647 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:44.244647 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:44.244647 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:44.245808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:44.245808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:44.245808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:44.245808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:44.245808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:44.245808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:44.245808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:13:44.245808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:13:44.245808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:13:44.245808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:13:44.245808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:44.245808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:44.245808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:44.245808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:44.245808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:44.245808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:44.246650 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:44.246650 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:44.246650 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:44.246650 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:44.246650 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:44.246650 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:44.246650 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:44.246650 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:44.246650 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:44.246650 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:44.246650 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:13:44.246650 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:44.246650 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 16:13:44.246650 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:13:44.246650 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 407/811] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:13:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:44.251833 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e49a2e-bca0-4926-88c3-7607a8c1bce0 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:44.333730 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:44.352845 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e49a2e-bca0-4926-88c3-7607a8c1bce0 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:44.385456 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3c8b8-e8ad-40c0-8148-9e8b153e754d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:44.386065 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3c8b8-e8ad-40c0-8148-9e8b153e754d None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:44.386347 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3c8b8-e8ad-40c0-8148-9e8b153e754d None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:44.386620 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3c8b8-e8ad-40c0-8148-9e8b153e754d None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:44.387286 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3c8b8-e8ad-40c0-8148-9e8b153e754d None admin] RBAC: Adding query filter params (name=compute) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:44.387616 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3c8b8-e8ad-40c0-8148-9e8b153e754d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:44.388978 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3c8b8-e8ad-40c0-8148-9e8b153e754d None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:44.394214 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 405/812] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 16:13:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:44.400026 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f2aa6-dfdf-424e-a485-3a22a574d46e None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:44.452838 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:44.498484 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f2aa6-dfdf-424e-a485-3a22a574d46e None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:44.531501 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5ff3a-35b2-4b20-b398-52b90f838088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:44.532117 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5ff3a-35b2-4b20-b398-52b90f838088 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:44.532402 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5ff3a-35b2-4b20-b398-52b90f838088 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:44.532683 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5ff3a-35b2-4b20-b398-52b90f838088 None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:44.533360 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5ff3a-35b2-4b20-b398-52b90f838088 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:44.533668 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5ff3a-35b2-4b20-b398-52b90f838088 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:44.535033 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5ff3a-35b2-4b20-b398-52b90f838088 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:44.539809 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 408/813] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 16:13:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:44.545980 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3c8b8-e8ad-40c0-8148-9e8b153e754d None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:44.643715 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3c8b8-e8ad-40c0-8148-9e8b153e754d None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:44.677581 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13adc681-1ba4-470b-8397-14260cfaa6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:44.678214 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adc681-1ba4-470b-8397-14260cfaa6d1 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:44.678498 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adc681-1ba4-470b-8397-14260cfaa6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:44.678774 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adc681-1ba4-470b-8397-14260cfaa6d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:44.679559 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13adc681-1ba4-470b-8397-14260cfaa6d1 None admin] RBAC: Adding query filter params (interface=public, service_id=cb17335177d84706900b84464797a95d, region_id=RegionOne) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:44.679876 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13adc681-1ba4-470b-8397-14260cfaa6d1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:44.681251 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13adc681-1ba4-470b-8397-14260cfaa6d1 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:44.686248 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 406/814] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Jul 27 16:13:44 2022] GET /identity/v3/endpoints?service_id=cb17335177d84706900b84464797a95d&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:44.692358 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5ff3a-35b2-4b20-b398-52b90f838088 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:44.788666 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5ff3a-35b2-4b20-b398-52b90f838088 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:44.804712 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:44.822650 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c7896-da17-4278-94ab-f9a02476a6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:44.823265 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c7896-da17-4278-94ab-f9a02476a6e9 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:44.823576 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c7896-da17-4278-94ab-f9a02476a6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:44.823860 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c7896-da17-4278-94ab-f9a02476a6e9 None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:44.824512 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c7896-da17-4278-94ab-f9a02476a6e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:44.825883 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c7896-da17-4278-94ab-f9a02476a6e9 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:44.832256 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 409/815] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Jul 27 16:13:44 2022] GET /identity/v3/services => generated 1728 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:13:47.029982 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf04ff-9d87-489d-9ae2-ba84f2737dff None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:47.030489 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf04ff-9d87-489d-9ae2-ba84f2737dff None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:47.030489 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf04ff-9d87-489d-9ae2-ba84f2737dff None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:47.032392 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 407/816] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:13:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:13:47.037457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604979d9-88a1-4e98-bda8-b3385fa1ffc4 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:47.037901 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604979d9-88a1-4e98-bda8-b3385fa1ffc4 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:47.038024 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604979d9-88a1-4e98-bda8-b3385fa1ffc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:47.056290 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-604979d9-88a1-4e98-bda8-b3385fa1ffc4 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:13:47.057477 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-604979d9-88a1-4e98-bda8-b3385fa1ffc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:13:47.121664 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 410/817] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:13:47 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:13:47.145823 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf04ff-9d87-489d-9ae2-ba84f2737dff None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:47.157255 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:47.251943 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf04ff-9d87-489d-9ae2-ba84f2737dff None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:47.285487 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389ad94-f371-4f7a-9f7a-087f665797e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:47.286073 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389ad94-f371-4f7a-9f7a-087f665797e0 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:47.286358 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389ad94-f371-4f7a-9f7a-087f665797e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:47.286638 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389ad94-f371-4f7a-9f7a-087f665797e0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:47.287269 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6389ad94-f371-4f7a-9f7a-087f665797e0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:47.288663 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6389ad94-f371-4f7a-9f7a-087f665797e0 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:47.297703 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-6389ad94-f371-4f7a-9f7a-087f665797e0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 16:13:47.297703 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:47.297703 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:13:47.297703 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:13:47.297703 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:13:47.297703 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:13:47.297703 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:13:47.297703 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:47.297703 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 16:13:47.297703 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:47.297703 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:13:47.297703 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:47.297703 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:13:47.297703 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:13:47.297703 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:13:47.297703 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:13:47.297703 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:13:47.298874 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:13:47.298874 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:13:47.298874 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:13:47.298874 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:13:47.298874 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:13:47.298874 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:13:47.298874 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:13:47.298874 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:13:47.298874 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:13:47.298874 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:13:47.298874 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:13:47.298874 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:13:47.298874 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:13:47.298874 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:13:47.298874 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:13:47.298874 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:13:47.299960 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:13:47.299960 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:13:47.299960 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:13:47.299960 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:13:47.299960 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:13:47.299960 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:13:47.299960 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:13:47.299960 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:13:47.299960 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:13:47.299960 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:13:47.299960 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:13:47.299960 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:13:47.299960 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 16:13:47.299960 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:13:47.299960 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 408/818] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:13:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:13:47.304929 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604979d9-88a1-4e98-bda8-b3385fa1ffc4 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:47.403268 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604979d9-88a1-4e98-bda8-b3385fa1ffc4 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:47.413632 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:47.436983 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb71e3-7463-41ae-986e-30e26d86313c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:47.438117 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb71e3-7463-41ae-986e-30e26d86313c None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:47.438403 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb71e3-7463-41ae-986e-30e26d86313c None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:47.438679 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb71e3-7463-41ae-986e-30e26d86313c None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:47.439350 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb71e3-7463-41ae-986e-30e26d86313c None admin] RBAC: Adding query filter params (name=compute) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:47.439684 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb71e3-7463-41ae-986e-30e26d86313c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:47.441060 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb71e3-7463-41ae-986e-30e26d86313c None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:47.445713 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 411/819] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 16:13:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:47.451492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389ad94-f371-4f7a-9f7a-087f665797e0 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:47.521108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:47.551032 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389ad94-f371-4f7a-9f7a-087f665797e0 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:47.585603 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d2e8e5-3475-4c38-bb63-303abc53d540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:47.586264 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2e8e5-3475-4c38-bb63-303abc53d540 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:47.586587 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2e8e5-3475-4c38-bb63-303abc53d540 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:47.586904 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2e8e5-3475-4c38-bb63-303abc53d540 None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:47.587829 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d2e8e5-3475-4c38-bb63-303abc53d540 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:13:47.588168 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d2e8e5-3475-4c38-bb63-303abc53d540 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:47.589661 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d2e8e5-3475-4c38-bb63-303abc53d540 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:47.595580 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 409/820] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 16:13:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:13:47.601349 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb71e3-7463-41ae-986e-30e26d86313c None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:13:47.700582 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb71e3-7463-41ae-986e-30e26d86313c None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:13:47.732698 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a235d15-e290-4dcf-be57-6fec2498ee93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:13:47.733315 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a235d15-e290-4dcf-be57-6fec2498ee93 None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:13:47.733594 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a235d15-e290-4dcf-be57-6fec2498ee93 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:13:47.733892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a235d15-e290-4dcf-be57-6fec2498ee93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:13:47.735106 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a235d15-e290-4dcf-be57-6fec2498ee93 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:13:47.736513 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a235d15-e290-4dcf-be57-6fec2498ee93 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:13:47.762424 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 412/821] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 16:13:47 2022] POST /identity/v3/endpoints => generated 334 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:13:57.592453 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=32 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:13:57.755668 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=84,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:14:49.352735 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbd55b-7f4a-49e0-adb3-9d38d1ca06c5 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:14:49.353340 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbd55b-7f4a-49e0-adb3-9d38d1ca06c5 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:14:49.353340 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbd55b-7f4a-49e0-adb3-9d38d1ca06c5 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:14:49.354875 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 410/822] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:14:49.360729 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf07db-f0c9-4760-8209-8280b962302a None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:14:49.361362 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf07db-f0c9-4760-8209-8280b962302a None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:14:49.361362 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf07db-f0c9-4760-8209-8280b962302a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:14:49.382296 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-e3cf07db-f0c9-4760-8209-8280b962302a None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:14:49.384225 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-e3cf07db-f0c9-4760-8209-8280b962302a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:14:49.473808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 413/823] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:14:49 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:14:49.501778 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dbd55b-7f4a-49e0-adb3-9d38d1ca06c5 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:14:49.635673 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dbd55b-7f4a-49e0-adb3-9d38d1ca06c5 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:14:49.691281 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8efc57-34d1-4fab-9b87-9cbe297c3fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:14:49.692200 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8efc57-34d1-4fab-9b87-9cbe297c3fcf None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:14:49.692634 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8efc57-34d1-4fab-9b87-9cbe297c3fcf None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:14:49.693053 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8efc57-34d1-4fab-9b87-9cbe297c3fcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:14:49.710551 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8efc57-34d1-4fab-9b87-9cbe297c3fcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:14:49.712468 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8efc57-34d1-4fab-9b87-9cbe297c3fcf None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:14:49.731831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-3c8efc57-34d1-4fab-9b87-9cbe297c3fcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:14:49.731831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:14:49.731831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:14:49.731831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:14:49.731831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:14:49.731831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:14:49.731831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:14:49.731831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:14:49.731831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:14:49.731831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:14:49.731831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:14:49.731831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:14:49.731831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:14:49.731831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:14:49.731831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:14:49.732889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:14:49.732889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:14:49.732889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:14:49.732889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:14:49.732889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:14:49.732889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:14:49.732889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:14:49.732889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:14:49.732889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:14:49.732889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:14:49.732889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:14:49.732889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:14:49.732889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:14:49.732889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:14:49.732889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:14:49.732889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:14:49.732889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:14:49.733838 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:14:49.733838 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:14:49.733838 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:14:49.733838 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:14:49.733838 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 411/824] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:14:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:14:49.740372 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf07db-f0c9-4760-8209-8280b962302a None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:14:49.855582 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf07db-f0c9-4760-8209-8280b962302a None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:14:49.887957 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:14:49.899888 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998da49-501f-4a9b-ba9d-a374f5a5a731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:14:49.900587 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998da49-501f-4a9b-ba9d-a374f5a5a731 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:14:49.900841 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998da49-501f-4a9b-ba9d-a374f5a5a731 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:14:49.901156 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998da49-501f-4a9b-ba9d-a374f5a5a731 None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:14:49.901941 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998da49-501f-4a9b-ba9d-a374f5a5a731 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:14:49.902273 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998da49-501f-4a9b-ba9d-a374f5a5a731 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:14:49.903799 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998da49-501f-4a9b-ba9d-a374f5a5a731 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:14:49.919432 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 414/825] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:14:49.925312 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8efc57-34d1-4fab-9b87-9cbe297c3fcf None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:14:49.991049 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:14:50.051729 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8efc57-34d1-4fab-9b87-9cbe297c3fcf None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:14:50.090957 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b62b64-d824-4cb5-bd30-fd26d8fe9b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:14:50.091685 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b62b64-d824-4cb5-bd30-fd26d8fe9b60 None admin] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:14:50.091981 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b62b64-d824-4cb5-bd30-fd26d8fe9b60 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:14:50.092283 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b62b64-d824-4cb5-bd30-fd26d8fe9b60 None admin] PATH_INFO: `/v3/users` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:14:50.093081 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b62b64-d824-4cb5-bd30-fd26d8fe9b60 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:14:50.095317 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b62b64-d824-4cb5-bd30-fd26d8fe9b60 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:14:50.127452 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 412/826] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 16:14:49 2022] POST /identity/v3/users => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:14:52.473100 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d1af7-9cce-4362-b5bc-4b0f42c0fc4b None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:14:52.473800 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d1af7-9cce-4362-b5bc-4b0f42c0fc4b None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:14:52.473800 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d1af7-9cce-4362-b5bc-4b0f42c0fc4b None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:14:52.475104 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 415/827] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:14:52.480684 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58308052-b604-4063-a9cd-221d9017c2b0 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:14:52.481155 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58308052-b604-4063-a9cd-221d9017c2b0 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:14:52.481254 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58308052-b604-4063-a9cd-221d9017c2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:14:52.501576 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-58308052-b604-4063-a9cd-221d9017c2b0 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:14:52.502895 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-58308052-b604-4063-a9cd-221d9017c2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:14:52.583274 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 413/828] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:14:52 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:14:52.607558 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d1af7-9cce-4362-b5bc-4b0f42c0fc4b None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:14:52.731423 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d1af7-9cce-4362-b5bc-4b0f42c0fc4b None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:14:52.768642 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2aa968-bb92-4fee-b93d-e878075ccaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:14:52.769358 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2aa968-bb92-4fee-b93d-e878075ccaac None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:14:52.769682 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2aa968-bb92-4fee-b93d-e878075ccaac None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:14:52.770032 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2aa968-bb92-4fee-b93d-e878075ccaac None admin] PATH_INFO: `/v3/roles/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:14:52.783196 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2aa968-bb92-4fee-b93d-e878075ccaac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:14:52.788955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-2c2aa968-bb92-4fee-b93d-e878075ccaac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:14:52.788955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:14:52.788955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:14:52.788955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:14:52.788955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:14:52.788955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:14:52.788955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:14:52.788955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:14:52.788955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:14:52.788955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:14:52.788955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:14:52.788955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:14:52.788955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:14:52.788955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:14:52.788955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:14:52.788955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:14:52.790072 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:14:52.790072 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:14:52.790072 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:14:52.790072 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:14:52.790072 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:14:52.790072 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:14:52.790072 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:14:52.790072 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:14:52.790072 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:14:52.790072 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:14:52.790072 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:14:52.790072 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:14:52.790072 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:14:52.790072 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:14:52.790072 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:14:52.790072 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:14:52.790941 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:14:52.790941 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:14:52.790941 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:14:52.790941 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:14:52.790941 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:14:52.790941 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:14:52.790941 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:14:52.790941 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:14:52.790941 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:14:52.790941 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:14:52.790941 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:14:52.790941 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:14:52.790941 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 416/829] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 16:14:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:14:52.796872 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58308052-b604-4063-a9cd-221d9017c2b0 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:14:52.846245 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:14:52.924638 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58308052-b604-4063-a9cd-221d9017c2b0 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:14:52.968849 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c43f5d-7607-411a-b7a6-5c4ea9f55fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:14:52.970078 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c43f5d-7607-411a-b7a6-5c4ea9f55fba None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:14:52.970361 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c43f5d-7607-411a-b7a6-5c4ea9f55fba None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:14:52.970634 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c43f5d-7607-411a-b7a6-5c4ea9f55fba None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:14:52.971346 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c43f5d-7607-411a-b7a6-5c4ea9f55fba None admin] RBAC: Adding query filter params (name=service) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:14:52.971673 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c43f5d-7607-411a-b7a6-5c4ea9f55fba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:14:52.973067 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c43f5d-7607-411a-b7a6-5c4ea9f55fba None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:14:52.982583 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 414/830] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 16:14:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:14:52.988651 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2aa968-bb92-4fee-b93d-e878075ccaac None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:14:53.044326 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:14:53.114650 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2aa968-bb92-4fee-b93d-e878075ccaac None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:14:53.152147 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfca51-98fc-4388-a294-8d403b895d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:14:53.152797 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfca51-98fc-4388-a294-8d403b895d01 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:14:53.153079 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfca51-98fc-4388-a294-8d403b895d01 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:14:53.153354 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfca51-98fc-4388-a294-8d403b895d01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:14:53.166287 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdfca51-98fc-4388-a294-8d403b895d01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:14:53.167947 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdfca51-98fc-4388-a294-8d403b895d01 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:14:53.184274 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-1cdfca51-98fc-4388-a294-8d403b895d01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:14:53.184274 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:14:53.184274 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:14:53.184274 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:14:53.184274 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:14:53.184274 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:14:53.184274 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:14:53.184274 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:14:53.184274 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:14:53.184274 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:14:53.184274 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:14:53.184274 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:14:53.184274 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:14:53.184274 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:14:53.184274 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:14:53.185422 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:14:53.185422 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:14:53.185422 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:14:53.185422 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:14:53.185422 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:14:53.185422 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:14:53.185422 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:14:53.185422 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:14:53.185422 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:14:53.185422 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:14:53.185422 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:14:53.185422 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:14:53.185422 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:14:53.185422 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:14:53.185422 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:14:53.185422 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:14:53.185422 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:14:53.186489 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:14:53.186489 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:14:53.186489 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:14:53.186489 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:14:53.186489 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 417/831] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:14:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:14:53.192818 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c43f5d-7607-411a-b7a6-5c4ea9f55fba None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:14:53.314353 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:14:53.317826 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c43f5d-7607-411a-b7a6-5c4ea9f55fba None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:14:53.358949 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838cff41-b9a1-451f-a0fc-988438aac44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:14:53.359644 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838cff41-b9a1-451f-a0fc-988438aac44f None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:14:53.359905 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838cff41-b9a1-451f-a0fc-988438aac44f None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:14:53.360247 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838cff41-b9a1-451f-a0fc-988438aac44f None admin] PATH_INFO: `/v3/domains` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:14:53.360999 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838cff41-b9a1-451f-a0fc-988438aac44f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:14:53.361299 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838cff41-b9a1-451f-a0fc-988438aac44f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:14:53.362768 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838cff41-b9a1-451f-a0fc-988438aac44f None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:14:53.376710 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 415/832] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:14:53.384361 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfca51-98fc-4388-a294-8d403b895d01 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:14:53.509058 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:14:53.514196 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfca51-98fc-4388-a294-8d403b895d01 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:14:53.555835 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fde948-7aa1-43ae-ac75-650e1d1f25ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:14:53.556580 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fde948-7aa1-43ae-ac75-650e1d1f25ac None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:14:53.556858 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fde948-7aa1-43ae-ac75-650e1d1f25ac None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:14:53.557133 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fde948-7aa1-43ae-ac75-650e1d1f25ac None admin] PATH_INFO: `/v3/users/placement` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:14:53.566229 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fde948-7aa1-43ae-ac75-650e1d1f25ac None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:14:53.567888 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fde948-7aa1-43ae-ac75-650e1d1f25ac None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:14:53.581406 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-21fde948-7aa1-43ae-ac75-650e1d1f25ac None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 16:14:53.581406 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:14:53.581406 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:14:53.581406 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:14:53.581406 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:14:53.581406 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:14:53.581406 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:14:53.581406 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:14:53.581406 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:14:53.581406 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:14:53.581406 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:14:53.581406 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:14:53.581406 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:14:53.581406 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:14:53.581406 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:14:53.581406 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:14:53.582566 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:14:53.582566 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:14:53.582566 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:14:53.582566 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:14:53.582566 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:14:53.582566 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:14:53.582566 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:14:53.582566 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:14:53.582566 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:14:53.582566 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:14:53.582566 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:14:53.582566 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:14:53.582566 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:14:53.582566 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:14:53.582566 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:14:53.582566 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:14:53.582566 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:14:53.582566 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:14:53.583911 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:14:53.583911 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:14:53.583911 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:14:53.583911 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:14:53.583911 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:14:53.583911 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:14:53.583911 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:14:53.583911 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:14:53.583911 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 16:14:53.583911 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:14:53.583911 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 418/833] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:14:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:14:53.588872 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838cff41-b9a1-451f-a0fc-988438aac44f None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:14:53.711480 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838cff41-b9a1-451f-a0fc-988438aac44f None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:14:53.755065 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d80e61-1015-4121-9f90-8743f9aaf8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:14:53.755754 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d80e61-1015-4121-9f90-8743f9aaf8c6 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:14:53.756061 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d80e61-1015-4121-9f90-8743f9aaf8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:14:53.756334 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d80e61-1015-4121-9f90-8743f9aaf8c6 None admin] PATH_INFO: `/v3/users` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:14:53.757191 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d80e61-1015-4121-9f90-8743f9aaf8c6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:14:53.757645 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d80e61-1015-4121-9f90-8743f9aaf8c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:14:53.758972 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d80e61-1015-4121-9f90-8743f9aaf8c6 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:14:53.780073 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 416/834] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Jul 27 16:14:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:14:53.789172 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fde948-7aa1-43ae-ac75-650e1d1f25ac None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:14:53.910881 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fde948-7aa1-43ae-ac75-650e1d1f25ac None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:14:53.961549 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2adf5-e415-48c5-95d2-d1d766ed47a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:14:53.962175 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2adf5-e415-48c5-95d2-d1d766ed47a6 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:14:53.962462 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2adf5-e415-48c5-95d2-d1d766ed47a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:14:53.962741 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2adf5-e415-48c5-95d2-d1d766ed47a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:14:53.999539 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:14:54.046641 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2adf5-e415-48c5-95d2-d1d766ed47a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:14:54.048469 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2adf5-e415-48c5-95d2-d1d766ed47a6 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:14:54.163574 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 419/835] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:14:53 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 16:14:54.163932 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d80e61-1015-4121-9f90-8743f9aaf8c6 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:14:54.184378 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:14:54.277562 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d80e61-1015-4121-9f90-8743f9aaf8c6 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:14:54.314836 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d304e-04c5-46c3-8ed9-013a5743538a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:14:54.315518 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d304e-04c5-46c3-8ed9-013a5743538a None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:14:54.315805 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d304e-04c5-46c3-8ed9-013a5743538a None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:14:54.316109 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d304e-04c5-46c3-8ed9-013a5743538a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:14:54.329730 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d304e-04c5-46c3-8ed9-013a5743538a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:14:54.331443 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d304e-04c5-46c3-8ed9-013a5743538a None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:14:54.351766 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-831d304e-04c5-46c3-8ed9-013a5743538a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:14:54.351766 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:14:54.351766 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:14:54.351766 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:14:54.351766 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:14:54.351766 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:14:54.351766 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:14:54.351766 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:14:54.351766 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:14:54.351766 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:14:54.351766 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:14:54.351766 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:14:54.351766 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:14:54.351766 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:14:54.351766 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:14:54.352863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:14:54.352863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:14:54.352863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:14:54.352863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:14:54.352863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:14:54.352863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:14:54.352863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:14:54.352863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:14:54.352863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:14:54.352863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:14:54.352863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:14:54.352863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:14:54.352863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:14:54.352863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:14:54.352863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:14:54.352863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:14:54.352863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:14:54.359195 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:14:54.359195 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:14:54.359195 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:14:54.359195 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:14:54.359195 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 417/836] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:14:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:14:54.361390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2adf5-e415-48c5-95d2-d1d766ed47a6 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:14:54.421578 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:14:54.465239 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2adf5-e415-48c5-95d2-d1d766ed47a6 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:14:54.504356 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00156e5-697a-4b5f-ad19-11669b6c851e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:14:54.504988 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00156e5-697a-4b5f-ad19-11669b6c851e None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:14:54.505283 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00156e5-697a-4b5f-ad19-11669b6c851e None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:14:54.505558 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00156e5-697a-4b5f-ad19-11669b6c851e None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:14:54.506250 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00156e5-697a-4b5f-ad19-11669b6c851e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:14:54.506561 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00156e5-697a-4b5f-ad19-11669b6c851e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:14:54.507990 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00156e5-697a-4b5f-ad19-11669b6c851e None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:14:54.524976 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 420/837] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:14:54.526154 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d304e-04c5-46c3-8ed9-013a5743538a None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:14:54.601238 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:14:54.636552 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d304e-04c5-46c3-8ed9-013a5743538a None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:14:54.677035 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71544a8-d973-4303-a695-7f511c59d239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:14:54.677658 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71544a8-d973-4303-a695-7f511c59d239 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:14:54.677972 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71544a8-d973-4303-a695-7f511c59d239 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:14:54.678296 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71544a8-d973-4303-a695-7f511c59d239 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:14:54.685524 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71544a8-d973-4303-a695-7f511c59d239 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:14:54.686975 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71544a8-d973-4303-a695-7f511c59d239 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:14:54.698968 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-b71544a8-d973-4303-a695-7f511c59d239 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:14:54.698968 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:14:54.698968 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:14:54.698968 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:14:54.698968 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:14:54.698968 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:14:54.698968 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:14:54.698968 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:14:54.698968 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:14:54.698968 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:14:54.698968 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:14:54.698968 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:14:54.698968 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:14:54.698968 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:14:54.698968 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:14:54.700130 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:14:54.700130 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:14:54.700130 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:14:54.700130 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:14:54.700130 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:14:54.700130 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:14:54.700130 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:14:54.700130 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:14:54.700130 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:14:54.700130 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:14:54.700130 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:14:54.700130 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:14:54.700130 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:14:54.700130 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:14:54.700130 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:14:54.700130 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:14:54.700130 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:14:54.701470 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:14:54.701470 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:14:54.701470 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:14:54.701470 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:14:54.701470 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:14:54.701470 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:14:54.701470 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:14:54.701470 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:14:54.701470 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 418/838] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:14:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:14:54.706567 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00156e5-697a-4b5f-ad19-11669b6c851e None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:14:54.816401 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00156e5-697a-4b5f-ad19-11669b6c851e None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:14:54.833540 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:14:54.854907 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3db9e1-08a0-4618-bfb4-bea6f1a5aa20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:14:54.855634 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3db9e1-08a0-4618-bfb4-bea6f1a5aa20 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:14:54.855952 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3db9e1-08a0-4618-bfb4-bea6f1a5aa20 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:14:54.856237 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3db9e1-08a0-4618-bfb4-bea6f1a5aa20 None admin] PATH_INFO: `/v3/projects` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:14:54.857166 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3db9e1-08a0-4618-bfb4-bea6f1a5aa20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:14:54.857486 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3db9e1-08a0-4618-bfb4-bea6f1a5aa20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:14:54.858995 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3db9e1-08a0-4618-bfb4-bea6f1a5aa20 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:14:54.872643 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 421/839] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 16:14:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:14:54.879733 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71544a8-d973-4303-a695-7f511c59d239 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:14:54.991628 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71544a8-d973-4303-a695-7f511c59d239 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:14:55.031389 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:14:55.038094 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175bf28-696b-40d4-be17-7637cb21caf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:14:55.038718 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175bf28-696b-40d4-be17-7637cb21caf7 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:14:55.039004 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175bf28-696b-40d4-be17-7637cb21caf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:14:55.039325 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175bf28-696b-40d4-be17-7637cb21caf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:14:55.040234 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175bf28-696b-40d4-be17-7637cb21caf7 None admin] RBAC: Adding query filter params (role.id=738aa511871f47acb7169da7e104be79, scope.project.id=73d63a3d7b724a5998ea2976430f242d, user.id=c311ccdc0d434bb6a9ef99da9a5404bf) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:14:55.040547 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175bf28-696b-40d4-be17-7637cb21caf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:14:55.042166 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175bf28-696b-40d4-be17-7637cb21caf7 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:14:55.048986 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 419/840] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 16:14:54 2022] GET /identity/v3/role_assignments?user.id=c311ccdc0d434bb6a9ef99da9a5404bf&scope.project.id=73d63a3d7b724a5998ea2976430f242d&role.id=738aa511871f47acb7169da7e104be79 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:14:57.386845 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99f644-043e-4c29-a4d7-5c043b4b880d None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:14:57.387427 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99f644-043e-4c29-a4d7-5c043b4b880d None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:14:57.387522 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99f644-043e-4c29-a4d7-5c043b4b880d None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:14:57.389013 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 422/841] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:14:57.395391 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847c921-25cd-41aa-ada5-f6921df991dd None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:14:57.395820 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847c921-25cd-41aa-ada5-f6921df991dd None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:14:57.395978 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847c921-25cd-41aa-ada5-f6921df991dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:14:57.415864 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-3847c921-25cd-41aa-ada5-f6921df991dd None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:14:57.417066 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-3847c921-25cd-41aa-ada5-f6921df991dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:14:57.492047 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 420/842] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:14:57 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:14:57.517508 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99f644-043e-4c29-a4d7-5c043b4b880d None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:14:57.630390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99f644-043e-4c29-a4d7-5c043b4b880d None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:14:57.668587 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4eceeb-9f5c-465c-a1e9-cf7518e525c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:14:57.669922 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4eceeb-9f5c-465c-a1e9-cf7518e525c1 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:14:57.670824 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4eceeb-9f5c-465c-a1e9-cf7518e525c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:14:57.670824 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4eceeb-9f5c-465c-a1e9-cf7518e525c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:14:57.684615 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4eceeb-9f5c-465c-a1e9-cf7518e525c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:14:57.690755 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-5b4eceeb-9f5c-465c-a1e9-cf7518e525c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:14:57.690755 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:14:57.690755 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:14:57.690755 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:14:57.690755 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:14:57.690755 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:14:57.690755 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:14:57.690755 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:14:57.690755 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:14:57.690755 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:14:57.690755 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:14:57.690755 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:14:57.690755 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:14:57.690755 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:14:57.690755 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:14:57.690755 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:14:57.691852 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:14:57.691852 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:14:57.691852 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:14:57.691852 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:14:57.691852 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:14:57.691852 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:14:57.691852 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:14:57.691852 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:14:57.691852 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:14:57.691852 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:14:57.691852 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:14:57.691852 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:14:57.691852 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:14:57.691852 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:14:57.691852 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:14:57.691852 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:14:57.692694 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:14:57.692694 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:14:57.692694 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:14:57.692694 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:14:57.692694 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:14:57.692694 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:14:57.692694 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:14:57.692694 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:14:57.692694 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:14:57.692694 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:14:57.692694 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:14:57.692694 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:14:57.692694 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 423/843] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 16:14:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:14:57.698511 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847c921-25cd-41aa-ada5-f6921df991dd None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:14:57.810157 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847c921-25cd-41aa-ada5-f6921df991dd None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:14:57.836909 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:14:57.848640 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e63055-e424-46e2-882b-9ded68b4fb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:14:57.849482 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e63055-e424-46e2-882b-9ded68b4fb42 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:14:57.849930 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e63055-e424-46e2-882b-9ded68b4fb42 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:14:57.850203 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e63055-e424-46e2-882b-9ded68b4fb42 None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:14:57.850919 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e63055-e424-46e2-882b-9ded68b4fb42 None admin] RBAC: Adding query filter params (name=service) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:14:57.851246 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e63055-e424-46e2-882b-9ded68b4fb42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:14:57.852646 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e63055-e424-46e2-882b-9ded68b4fb42 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:14:57.861881 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 421/844] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 16:14:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:14:57.869695 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4eceeb-9f5c-465c-a1e9-cf7518e525c1 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:14:57.917830 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:14:57.988718 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4eceeb-9f5c-465c-a1e9-cf7518e525c1 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:14:58.024733 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd2702-4e17-4e3b-be9d-8b46dfa183f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:14:58.025391 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd2702-4e17-4e3b-be9d-8b46dfa183f6 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:14:58.025653 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd2702-4e17-4e3b-be9d-8b46dfa183f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:14:58.025928 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd2702-4e17-4e3b-be9d-8b46dfa183f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:14:58.036901 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd2702-4e17-4e3b-be9d-8b46dfa183f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:14:58.038462 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd2702-4e17-4e3b-be9d-8b46dfa183f6 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:14:58.053772 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-91dd2702-4e17-4e3b-be9d-8b46dfa183f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:14:58.053772 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:14:58.053772 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:14:58.053772 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:14:58.053772 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:14:58.053772 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:14:58.053772 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:14:58.053772 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:14:58.053772 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:14:58.053772 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:14:58.053772 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:14:58.053772 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:14:58.053772 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:14:58.053772 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:14:58.053772 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:14:58.054859 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:14:58.054859 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:14:58.054859 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:14:58.054859 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:14:58.054859 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:14:58.054859 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:14:58.054859 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:14:58.054859 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:14:58.054859 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:14:58.054859 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:14:58.054859 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:14:58.054859 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:14:58.054859 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:14:58.054859 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:14:58.054859 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:14:58.054859 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:14:58.054859 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:14:58.056113 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:14:58.056113 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:14:58.056113 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:14:58.056113 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:14:58.056113 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 424/845] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:14:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:14:58.060766 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e63055-e424-46e2-882b-9ded68b4fb42 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:14:58.172985 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e63055-e424-46e2-882b-9ded68b4fb42 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:14:58.208688 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a456c-c9a6-4019-bf2a-4d108d7df324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:14:58.209365 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a456c-c9a6-4019-bf2a-4d108d7df324 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:14:58.209649 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a456c-c9a6-4019-bf2a-4d108d7df324 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:14:58.209927 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a456c-c9a6-4019-bf2a-4d108d7df324 None admin] PATH_INFO: `/v3/domains` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:14:58.210613 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a456c-c9a6-4019-bf2a-4d108d7df324 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:14:58.210921 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a456c-c9a6-4019-bf2a-4d108d7df324 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:14:58.212342 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a456c-c9a6-4019-bf2a-4d108d7df324 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:14:58.225680 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 422/846] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:14:58.232216 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd2702-4e17-4e3b-be9d-8b46dfa183f6 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:14:58.340192 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:14:58.351839 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd2702-4e17-4e3b-be9d-8b46dfa183f6 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:14:58.389238 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd35f35-2404-4361-aa11-854c768adf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:14:58.390274 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd35f35-2404-4361-aa11-854c768adf99 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:14:58.390274 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd35f35-2404-4361-aa11-854c768adf99 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:14:58.390591 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd35f35-2404-4361-aa11-854c768adf99 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:14:58.398934 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd35f35-2404-4361-aa11-854c768adf99 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:14:58.400422 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd35f35-2404-4361-aa11-854c768adf99 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:14:58.412423 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-3cd35f35-2404-4361-aa11-854c768adf99 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 16:14:58.412423 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:14:58.412423 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:14:58.412423 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:14:58.412423 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:14:58.412423 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:14:58.412423 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:14:58.412423 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:14:58.412423 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:14:58.412423 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:14:58.412423 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:14:58.412423 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:14:58.412423 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:14:58.412423 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:14:58.412423 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:14:58.412423 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:14:58.414255 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:14:58.414255 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:14:58.414255 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:14:58.414255 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:14:58.414255 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:14:58.414255 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:14:58.414255 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:14:58.414255 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:14:58.414255 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:14:58.414255 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:14:58.414255 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:14:58.414255 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:14:58.414255 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:14:58.414255 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:14:58.414255 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:14:58.414255 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:14:58.414255 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:14:58.414255 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:14:58.416541 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:14:58.416541 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:14:58.416541 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:14:58.416541 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:14:58.416541 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:14:58.416541 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:14:58.416541 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:14:58.416541 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:14:58.416541 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 16:14:58.416541 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:14:58.416541 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 425/847] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:14:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:14:58.425868 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a456c-c9a6-4019-bf2a-4d108d7df324 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:14:58.482845 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:14:58.538827 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a456c-c9a6-4019-bf2a-4d108d7df324 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:14:58.576514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ff466-aabd-4025-b592-a59105fb6892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:14:58.577159 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ff466-aabd-4025-b592-a59105fb6892 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:14:58.577445 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ff466-aabd-4025-b592-a59105fb6892 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:14:58.577725 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ff466-aabd-4025-b592-a59105fb6892 None admin] PATH_INFO: `/v3/users` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:14:58.579261 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ff466-aabd-4025-b592-a59105fb6892 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:14:58.579637 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ff466-aabd-4025-b592-a59105fb6892 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:14:58.581163 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ff466-aabd-4025-b592-a59105fb6892 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:14:58.604057 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 423/848] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Jul 27 16:14:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:14:58.609769 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd35f35-2404-4361-aa11-854c768adf99 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:14:58.723645 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd35f35-2404-4361-aa11-854c768adf99 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:14:58.761695 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fc6ed-b489-46d2-bb54-c502b2458bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:14:58.762347 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fc6ed-b489-46d2-bb54-c502b2458bf4 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:14:58.762662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fc6ed-b489-46d2-bb54-c502b2458bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:14:58.762991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fc6ed-b489-46d2-bb54-c502b2458bf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:14:58.776250 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fc6ed-b489-46d2-bb54-c502b2458bf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:14:58.777875 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fc6ed-b489-46d2-bb54-c502b2458bf4 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:14:58.794701 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-741fc6ed-b489-46d2-bb54-c502b2458bf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:14:58.794701 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:14:58.794701 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:14:58.794701 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:14:58.794701 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:14:58.794701 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:14:58.794701 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:14:58.794701 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:14:58.794701 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:14:58.794701 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:14:58.794701 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:14:58.794701 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:14:58.794701 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:14:58.794701 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:14:58.794701 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:14:58.795837 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:14:58.795837 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:14:58.795837 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:14:58.795837 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:14:58.795837 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:14:58.795837 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:14:58.795837 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:14:58.795837 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:14:58.795837 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:14:58.795837 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:14:58.795837 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:14:58.795837 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:14:58.795837 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:14:58.795837 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:14:58.795837 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:14:58.795837 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:14:58.795837 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:14:58.796882 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:14:58.796882 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:14:58.796882 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:14:58.796882 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:14:58.796882 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 426/849] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:14:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:14:58.802861 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ff466-aabd-4025-b592-a59105fb6892 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:14:58.912683 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ff466-aabd-4025-b592-a59105fb6892 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:14:58.915111 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:14:58.953931 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ff868-261a-412d-b1e6-0665850e2da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:14:58.954881 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ff868-261a-412d-b1e6-0665850e2da1 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:14:58.955164 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ff868-261a-412d-b1e6-0665850e2da1 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:14:58.955475 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ff868-261a-412d-b1e6-0665850e2da1 None admin] PATH_INFO: `/v3/domains` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:14:58.956170 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ff868-261a-412d-b1e6-0665850e2da1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:14:58.956493 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ff868-261a-412d-b1e6-0665850e2da1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:14:58.957971 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ff868-261a-412d-b1e6-0665850e2da1 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:14:58.971048 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 424/850] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:14:58.977362 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fc6ed-b489-46d2-bb54-c502b2458bf4 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:14:58.980322 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:14:59.094417 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fc6ed-b489-46d2-bb54-c502b2458bf4 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:14:59.132056 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59a54a-b43b-480c-a329-03e77b5e0986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:14:59.132709 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59a54a-b43b-480c-a329-03e77b5e0986 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:14:59.133000 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59a54a-b43b-480c-a329-03e77b5e0986 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:14:59.133286 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59a54a-b43b-480c-a329-03e77b5e0986 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:14:59.140756 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59a54a-b43b-480c-a329-03e77b5e0986 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:14:59.142244 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59a54a-b43b-480c-a329-03e77b5e0986 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:14:59.156246 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-1d59a54a-b43b-480c-a329-03e77b5e0986 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:14:59.156246 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:14:59.156246 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:14:59.156246 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:14:59.156246 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:14:59.156246 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:14:59.156246 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:14:59.156246 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:14:59.156246 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:14:59.156246 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:14:59.156246 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:14:59.156246 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:14:59.156246 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:14:59.156246 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:14:59.156246 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:14:59.157390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:14:59.157390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:14:59.157390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:14:59.157390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:14:59.157390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:14:59.157390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:14:59.157390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:14:59.157390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:14:59.157390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:14:59.157390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:14:59.157390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:14:59.157390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:14:59.157390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:14:59.157390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:14:59.157390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:14:59.157390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:14:59.157390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:14:59.158408 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:14:59.158408 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:14:59.158408 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:14:59.158408 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:14:59.158408 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:14:59.158408 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:14:59.158408 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:14:59.158408 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:14:59.158408 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 427/851] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:14:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:14:59.164322 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ff868-261a-412d-b1e6-0665850e2da1 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:14:59.275694 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ff868-261a-412d-b1e6-0665850e2da1 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:14:59.314825 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54336c-028c-4a8b-9e04-a9d53a89f12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:14:59.315517 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54336c-028c-4a8b-9e04-a9d53a89f12f None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:14:59.315804 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54336c-028c-4a8b-9e04-a9d53a89f12f None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:14:59.316082 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54336c-028c-4a8b-9e04-a9d53a89f12f None admin] PATH_INFO: `/v3/projects` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:14:59.316830 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a54336c-028c-4a8b-9e04-a9d53a89f12f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:14:59.317183 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a54336c-028c-4a8b-9e04-a9d53a89f12f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:14:59.319765 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a54336c-028c-4a8b-9e04-a9d53a89f12f None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:14:59.332374 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 425/852] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 16:14:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:14:59.339614 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59a54a-b43b-480c-a329-03e77b5e0986 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:14:59.416834 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:14:59.465361 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59a54a-b43b-480c-a329-03e77b5e0986 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:14:59.502358 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5531f20-8f87-4e06-8257-f42e545ae240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:14:59.503083 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5531f20-8f87-4e06-8257-f42e545ae240 None admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:14:59.503384 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5531f20-8f87-4e06-8257-f42e545ae240 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:14:59.503721 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5531f20-8f87-4e06-8257-f42e545ae240 None admin] PATH_INFO: `/v3/projects/73d63a3d7b724a5998ea2976430f242d/users/c311ccdc0d434bb6a9ef99da9a5404bf/roles/738aa511871f47acb7169da7e104be79` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:14:59.519955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5531f20-8f87-4e06-8257-f42e545ae240 None admin] RBAC: Authorizing `identity:create_grant(project_id=73d63a3d7b724a5998ea2976430f242d, user_id=c311ccdc0d434bb6a9ef99da9a5404bf, role_id=738aa511871f47acb7169da7e104be79)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:14:59.521587 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5531f20-8f87-4e06-8257-f42e545ae240 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:14:59.535700 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 428/853] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 16:14:59 2022] PUT /identity/v3/projects/73d63a3d7b724a5998ea2976430f242d/users/c311ccdc0d434bb6a9ef99da9a5404bf/roles/738aa511871f47acb7169da7e104be79 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:15:01.802577 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf3d7d-8b5f-4007-9a27-042b254ea832 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:01.803170 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf3d7d-8b5f-4007-9a27-042b254ea832 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:01.803170 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf3d7d-8b5f-4007-9a27-042b254ea832 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:01.804501 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 426/854] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:15:01.810668 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d1b42-8263-4b7b-a030-7baace743305 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:01.811131 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d1b42-8263-4b7b-a030-7baace743305 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:01.811242 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d1b42-8263-4b7b-a030-7baace743305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:01.832898 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-f29d1b42-8263-4b7b-a030-7baace743305 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:15:01.834232 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-f29d1b42-8263-4b7b-a030-7baace743305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:15:01.920567 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 429/855] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:15:01 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 16:15:01.948148 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf3d7d-8b5f-4007-9a27-042b254ea832 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:01.978304 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:02.065928 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf3d7d-8b5f-4007-9a27-042b254ea832 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:02.100423 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977646bb-83d7-4b0d-b998-d9b4674787c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:02.101073 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977646bb-83d7-4b0d-b998-d9b4674787c4 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:02.101357 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977646bb-83d7-4b0d-b998-d9b4674787c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:02.101631 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977646bb-83d7-4b0d-b998-d9b4674787c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:02.112820 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977646bb-83d7-4b0d-b998-d9b4674787c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:15:02.117773 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-977646bb-83d7-4b0d-b998-d9b4674787c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:15:02.117773 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:15:02.117773 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:15:02.117773 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:15:02.117773 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:15:02.117773 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:15:02.117773 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:15:02.117773 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:15:02.117773 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:15:02.117773 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:15:02.117773 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:15:02.117773 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:15:02.117773 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:15:02.117773 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:15:02.117773 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:15:02.117773 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:15:02.118840 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:15:02.118840 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:15:02.118840 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:15:02.118840 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:15:02.118840 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:15:02.118840 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:15:02.118840 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:15:02.118840 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:15:02.118840 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:15:02.118840 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:15:02.118840 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:15:02.118840 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:15:02.118840 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:15:02.118840 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:15:02.118840 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:15:02.118840 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:15:02.119735 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:15:02.119735 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:15:02.119735 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:15:02.119735 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:15:02.119735 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:15:02.119735 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:15:02.119735 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:15:02.119735 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:15:02.119735 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:15:02.119735 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:15:02.119735 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:15:02.119735 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:15:02.119735 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 427/856] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 16:15:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:15:02.125961 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d1b42-8263-4b7b-a030-7baace743305 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:02.170080 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:02.232139 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d1b42-8263-4b7b-a030-7baace743305 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:02.269506 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3d8b2-f0f3-42bd-a7cb-81be2e51d4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:02.270238 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3d8b2-f0f3-42bd-a7cb-81be2e51d4a5 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:02.270561 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3d8b2-f0f3-42bd-a7cb-81be2e51d4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:02.270893 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3d8b2-f0f3-42bd-a7cb-81be2e51d4a5 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:02.275761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3d8b2-f0f3-42bd-a7cb-81be2e51d4a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:15:02.276147 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3d8b2-f0f3-42bd-a7cb-81be2e51d4a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:02.277802 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3d8b2-f0f3-42bd-a7cb-81be2e51d4a5 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:02.288206 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 430/857] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 16:15:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:15:02.294181 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977646bb-83d7-4b0d-b998-d9b4674787c4 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:02.398460 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:02.416076 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977646bb-83d7-4b0d-b998-d9b4674787c4 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:02.459774 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ac7d9-2997-4df1-af5c-77bf2cc531ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:02.460429 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ac7d9-2997-4df1-af5c-77bf2cc531ef None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:02.460717 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ac7d9-2997-4df1-af5c-77bf2cc531ef None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:02.460999 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ac7d9-2997-4df1-af5c-77bf2cc531ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:02.471745 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ac7d9-2997-4df1-af5c-77bf2cc531ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:02.473291 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ac7d9-2997-4df1-af5c-77bf2cc531ef None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:02.488877 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-200ac7d9-2997-4df1-af5c-77bf2cc531ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:15:02.488877 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:15:02.488877 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:15:02.488877 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:15:02.488877 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:15:02.488877 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:15:02.488877 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:15:02.488877 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:15:02.488877 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:15:02.488877 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:15:02.488877 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:15:02.488877 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:15:02.488877 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:15:02.488877 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:15:02.488877 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:15:02.490184 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:15:02.490184 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:15:02.490184 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:15:02.490184 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:15:02.490184 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:15:02.490184 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:15:02.490184 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:15:02.490184 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:15:02.490184 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:15:02.490184 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:15:02.490184 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:15:02.490184 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:15:02.490184 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:15:02.490184 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:15:02.490184 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:15:02.490184 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:15:02.490184 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:15:02.491086 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:15:02.491086 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:15:02.491086 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:15:02.491086 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:15:02.491086 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 428/858] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:15:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:15:02.496091 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3d8b2-f0f3-42bd-a7cb-81be2e51d4a5 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:02.608172 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3d8b2-f0f3-42bd-a7cb-81be2e51d4a5 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:02.610861 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:02.647089 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2c2f3-5e7e-47d8-bed6-1d2e1afdeeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:02.648420 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2c2f3-5e7e-47d8-bed6-1d2e1afdeeeb None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:02.648420 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2c2f3-5e7e-47d8-bed6-1d2e1afdeeeb None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:02.648420 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2c2f3-5e7e-47d8-bed6-1d2e1afdeeeb None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:02.649002 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2c2f3-5e7e-47d8-bed6-1d2e1afdeeeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:15:02.649313 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2c2f3-5e7e-47d8-bed6-1d2e1afdeeeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:02.650690 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2c2f3-5e7e-47d8-bed6-1d2e1afdeeeb None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:02.664118 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 431/859] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:15:02.670163 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ac7d9-2997-4df1-af5c-77bf2cc531ef None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:02.786285 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ac7d9-2997-4df1-af5c-77bf2cc531ef None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:02.822118 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badad535-c215-4d9d-9f51-ea9c2c2c9f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:02.822786 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badad535-c215-4d9d-9f51-ea9c2c2c9f09 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:02.823042 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badad535-c215-4d9d-9f51-ea9c2c2c9f09 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:02.823320 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badad535-c215-4d9d-9f51-ea9c2c2c9f09 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:02.826363 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:02.832933 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badad535-c215-4d9d-9f51-ea9c2c2c9f09 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:02.834541 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badad535-c215-4d9d-9f51-ea9c2c2c9f09 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:02.847492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-badad535-c215-4d9d-9f51-ea9c2c2c9f09 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 16:15:02.847492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:15:02.847492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:15:02.847492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:15:02.847492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:15:02.847492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:15:02.847492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:15:02.847492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:15:02.847492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:15:02.847492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:15:02.847492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:15:02.847492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:15:02.847492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:15:02.847492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:15:02.847492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:15:02.847492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:15:02.848534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:15:02.848534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:15:02.848534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:15:02.848534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:15:02.848534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:15:02.848534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:15:02.848534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:15:02.848534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:15:02.848534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:15:02.848534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:15:02.848534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:15:02.848534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:15:02.848534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:15:02.848534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:15:02.848534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:15:02.848534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:15:02.848534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:15:02.848534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:15:02.849493 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:15:02.849493 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:15:02.849493 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:15:02.849493 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:15:02.849493 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:15:02.849493 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:15:02.849493 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:15:02.849493 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:15:02.849493 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 16:15:02.849493 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:15:02.849493 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 429/860] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:15:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:15:02.854645 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2c2f3-5e7e-47d8-bed6-1d2e1afdeeeb None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:02.971451 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2c2f3-5e7e-47d8-bed6-1d2e1afdeeeb None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:03.008810 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34243b98-0d88-4118-9d3c-a0a1a53f4694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:03.009513 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34243b98-0d88-4118-9d3c-a0a1a53f4694 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:03.009800 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34243b98-0d88-4118-9d3c-a0a1a53f4694 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:03.010073 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34243b98-0d88-4118-9d3c-a0a1a53f4694 None admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:03.010863 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34243b98-0d88-4118-9d3c-a0a1a53f4694 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:15:03.011167 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34243b98-0d88-4118-9d3c-a0a1a53f4694 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:03.012651 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34243b98-0d88-4118-9d3c-a0a1a53f4694 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:03.030986 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 432/861] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Jul 27 16:15:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:15:03.037966 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badad535-c215-4d9d-9f51-ea9c2c2c9f09 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:03.146938 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badad535-c215-4d9d-9f51-ea9c2c2c9f09 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:03.192389 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb028db-3db6-4695-9f5d-ea2991552d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:03.193025 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb028db-3db6-4695-9f5d-ea2991552d55 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:03.193430 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb028db-3db6-4695-9f5d-ea2991552d55 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:03.193646 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb028db-3db6-4695-9f5d-ea2991552d55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:03.258092 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:03.268343 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb028db-3db6-4695-9f5d-ea2991552d55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:03.270031 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb028db-3db6-4695-9f5d-ea2991552d55 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:03.385337 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 430/862] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:15:03 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 16:15:03.391733 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34243b98-0d88-4118-9d3c-a0a1a53f4694 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:03.420768 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:03.505545 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34243b98-0d88-4118-9d3c-a0a1a53f4694 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:03.547980 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ee721-5c1a-489f-b8b4-6f06c6d5c421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:03.548640 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ee721-5c1a-489f-b8b4-6f06c6d5c421 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:03.548929 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ee721-5c1a-489f-b8b4-6f06c6d5c421 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:03.549207 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ee721-5c1a-489f-b8b4-6f06c6d5c421 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:03.560158 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ee721-5c1a-489f-b8b4-6f06c6d5c421 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:03.561704 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ee721-5c1a-489f-b8b4-6f06c6d5c421 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:03.577560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-405ee721-5c1a-489f-b8b4-6f06c6d5c421 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:15:03.577560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:15:03.577560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:15:03.577560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:15:03.577560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:15:03.577560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:15:03.577560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:15:03.577560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:15:03.577560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:15:03.577560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:15:03.577560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:15:03.577560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:15:03.577560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:15:03.577560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:15:03.577560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:15:03.578884 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:15:03.578884 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:15:03.578884 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:15:03.578884 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:15:03.578884 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:15:03.578884 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:15:03.578884 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:15:03.578884 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:15:03.578884 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:15:03.578884 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:15:03.578884 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:15:03.578884 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:15:03.578884 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:15:03.578884 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:15:03.578884 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:15:03.578884 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:15:03.578884 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:15:03.579915 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:15:03.579915 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:15:03.579915 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:15:03.579915 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:15:03.579915 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 433/863] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:15:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:15:03.584624 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb028db-3db6-4695-9f5d-ea2991552d55 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:03.692948 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:03.699836 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb028db-3db6-4695-9f5d-ea2991552d55 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:03.735153 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf82b3-cf1c-4f47-8b24-d7bade483034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:03.735821 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf82b3-cf1c-4f47-8b24-d7bade483034 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:03.736103 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf82b3-cf1c-4f47-8b24-d7bade483034 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:03.736381 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf82b3-cf1c-4f47-8b24-d7bade483034 None admin] PATH_INFO: `/v3/domains` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:03.737071 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf82b3-cf1c-4f47-8b24-d7bade483034 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:15:03.737404 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf82b3-cf1c-4f47-8b24-d7bade483034 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:03.738746 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf82b3-cf1c-4f47-8b24-d7bade483034 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:03.751055 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 431/864] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:15:03.757894 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ee721-5c1a-489f-b8b4-6f06c6d5c421 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:03.845705 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:03.874985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ee721-5c1a-489f-b8b4-6f06c6d5c421 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:03.913091 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649aed96-1529-4be0-af58-e235d68272c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:03.913808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649aed96-1529-4be0-af58-e235d68272c7 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:03.914140 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649aed96-1529-4be0-af58-e235d68272c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:03.914482 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649aed96-1529-4be0-af58-e235d68272c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:03.922206 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649aed96-1529-4be0-af58-e235d68272c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:03.924235 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649aed96-1529-4be0-af58-e235d68272c7 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:03.937001 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-649aed96-1529-4be0-af58-e235d68272c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:15:03.937001 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:15:03.937001 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:15:03.937001 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:15:03.937001 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:15:03.937001 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:15:03.937001 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:15:03.937001 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:15:03.937001 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:15:03.937001 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:15:03.937001 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:15:03.937001 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:15:03.937001 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:15:03.937001 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:15:03.937001 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:15:03.938135 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:15:03.938135 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:15:03.938135 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:15:03.938135 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:15:03.938135 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:15:03.938135 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:15:03.938135 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:15:03.938135 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:15:03.938135 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:15:03.938135 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:15:03.938135 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:15:03.938135 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:15:03.938135 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:15:03.938135 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:15:03.938135 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:15:03.938135 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:15:03.938135 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:15:03.939272 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:15:03.939272 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:15:03.939272 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:15:03.939272 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:15:03.939272 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:15:03.939272 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:15:03.939272 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:15:03.939272 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:15:03.939272 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 434/865] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:15:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:15:03.945636 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf82b3-cf1c-4f47-8b24-d7bade483034 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:04.056943 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf82b3-cf1c-4f47-8b24-d7bade483034 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:04.103057 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d032f3-87db-49f4-9e3c-de6f5e8572b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:04.103736 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d032f3-87db-49f4-9e3c-de6f5e8572b8 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:04.104014 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d032f3-87db-49f4-9e3c-de6f5e8572b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:04.104287 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d032f3-87db-49f4-9e3c-de6f5e8572b8 None admin] PATH_INFO: `/v3/projects` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:04.105151 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d032f3-87db-49f4-9e3c-de6f5e8572b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:15:04.105498 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d032f3-87db-49f4-9e3c-de6f5e8572b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:04.107015 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d032f3-87db-49f4-9e3c-de6f5e8572b8 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:04.121835 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 432/866] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 16:15:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:15:04.128731 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649aed96-1529-4be0-af58-e235d68272c7 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:04.263089 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649aed96-1529-4be0-af58-e235d68272c7 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:04.301789 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3585f1-4178-4ea0-8c37-9039402a0490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:04.302413 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3585f1-4178-4ea0-8c37-9039402a0490 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:04.302697 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3585f1-4178-4ea0-8c37-9039402a0490 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:04.302972 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3585f1-4178-4ea0-8c37-9039402a0490 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:04.303878 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3585f1-4178-4ea0-8c37-9039402a0490 None admin] RBAC: Adding query filter params (role.id=738aa511871f47acb7169da7e104be79, scope.project.id=73d63a3d7b724a5998ea2976430f242d, user.id=c311ccdc0d434bb6a9ef99da9a5404bf) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:15:04.304190 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3585f1-4178-4ea0-8c37-9039402a0490 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:04.305735 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3585f1-4178-4ea0-8c37-9039402a0490 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:04.307724 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:04.322518 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 435/867] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 16:15:04 2022] GET /identity/v3/role_assignments?user.id=c311ccdc0d434bb6a9ef99da9a5404bf&scope.project.id=73d63a3d7b724a5998ea2976430f242d&role.id=738aa511871f47acb7169da7e104be79 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:15:06.775446 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caacc049-1756-4128-8b33-de86f0b8f8b0 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:06.776107 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caacc049-1756-4128-8b33-de86f0b8f8b0 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:06.776107 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caacc049-1756-4128-8b33-de86f0b8f8b0 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:06.777341 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 433/868] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:15:06.783439 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39a4c0-4feb-4f53-9e16-ddf2433734d6 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:06.783909 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39a4c0-4feb-4f53-9e16-ddf2433734d6 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:06.784024 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39a4c0-4feb-4f53-9e16-ddf2433734d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:06.804206 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-8f39a4c0-4feb-4f53-9e16-ddf2433734d6 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:15:06.805457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-8f39a4c0-4feb-4f53-9e16-ddf2433734d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:15:06.874832 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 436/869] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:15:06 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:15:06.901077 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caacc049-1756-4128-8b33-de86f0b8f8b0 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:06.922845 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:07.021378 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caacc049-1756-4128-8b33-de86f0b8f8b0 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:07.056986 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a86bb9-5ecc-4838-a3ac-4b2a283f8f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:07.057769 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a86bb9-5ecc-4838-a3ac-4b2a283f8f0c None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:07.058055 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a86bb9-5ecc-4838-a3ac-4b2a283f8f0c None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:07.058325 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a86bb9-5ecc-4838-a3ac-4b2a283f8f0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:07.070251 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a86bb9-5ecc-4838-a3ac-4b2a283f8f0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:15:07.075276 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-e5a86bb9-5ecc-4838-a3ac-4b2a283f8f0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:15:07.075276 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:15:07.075276 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:15:07.075276 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:15:07.075276 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:15:07.075276 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:15:07.075276 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:15:07.075276 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:15:07.075276 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:15:07.075276 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:15:07.075276 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:15:07.075276 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:15:07.075276 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:15:07.075276 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:15:07.075276 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:15:07.075276 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:15:07.076610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:15:07.076610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:15:07.076610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:15:07.076610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:15:07.076610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:15:07.076610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:15:07.076610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:15:07.076610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:15:07.076610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:15:07.076610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:15:07.076610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:15:07.076610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:15:07.076610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:15:07.076610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:15:07.076610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:15:07.076610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:15:07.077521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:15:07.077521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:15:07.077521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:15:07.077521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:15:07.077521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:15:07.077521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:15:07.077521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:15:07.077521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:15:07.077521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:15:07.077521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:15:07.077521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:15:07.077521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:15:07.077521 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 434/870] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 16:15:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:15:07.082982 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39a4c0-4feb-4f53-9e16-ddf2433734d6 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:07.197500 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39a4c0-4feb-4f53-9e16-ddf2433734d6 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:07.237077 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:07.246369 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2da1c2-4d68-4353-a65e-07d909d9bd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:07.247079 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2da1c2-4d68-4353-a65e-07d909d9bd3c None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:07.247361 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2da1c2-4d68-4353-a65e-07d909d9bd3c None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:07.247662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2da1c2-4d68-4353-a65e-07d909d9bd3c None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:07.248457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2da1c2-4d68-4353-a65e-07d909d9bd3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:15:07.248768 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2da1c2-4d68-4353-a65e-07d909d9bd3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:07.250320 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2da1c2-4d68-4353-a65e-07d909d9bd3c None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:07.259144 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 437/871] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:15:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:15:07.265172 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a86bb9-5ecc-4838-a3ac-4b2a283f8f0c None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:07.362416 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:07.391702 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a86bb9-5ecc-4838-a3ac-4b2a283f8f0c None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:07.441491 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823b979-c60b-420d-9880-7778e080146f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:07.442355 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823b979-c60b-420d-9880-7778e080146f None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:07.442700 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823b979-c60b-420d-9880-7778e080146f None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:07.443037 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823b979-c60b-420d-9880-7778e080146f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:07.458158 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823b979-c60b-420d-9880-7778e080146f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:07.460783 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823b979-c60b-420d-9880-7778e080146f None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:07.483901 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-d823b979-c60b-420d-9880-7778e080146f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:15:07.483901 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:15:07.483901 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:15:07.483901 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:15:07.483901 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:15:07.483901 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:15:07.483901 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:15:07.483901 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:15:07.483901 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:15:07.483901 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:15:07.483901 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:15:07.483901 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:15:07.483901 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:15:07.483901 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:15:07.483901 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:15:07.490750 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:15:07.490750 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:15:07.490750 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:15:07.490750 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:15:07.490750 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:15:07.490750 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:15:07.490750 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:15:07.490750 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:15:07.490750 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:15:07.490750 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:15:07.490750 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:15:07.490750 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:15:07.490750 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:15:07.490750 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:15:07.490750 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:15:07.490750 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:15:07.490750 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:15:07.491662 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:15:07.491662 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:15:07.491662 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:15:07.491662 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:15:07.491662 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 435/872] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:15:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:15:07.491985 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2da1c2-4d68-4353-a65e-07d909d9bd3c None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:07.601371 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2da1c2-4d68-4353-a65e-07d909d9bd3c None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:07.642282 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0dabb9-eaa9-4d53-9f57-44841d4f3b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:07.642916 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0dabb9-eaa9-4d53-9f57-44841d4f3b9c None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:07.643230 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0dabb9-eaa9-4d53-9f57-44841d4f3b9c None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:07.643547 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0dabb9-eaa9-4d53-9f57-44841d4f3b9c None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:07.644254 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0dabb9-eaa9-4d53-9f57-44841d4f3b9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:15:07.644570 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0dabb9-eaa9-4d53-9f57-44841d4f3b9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:07.645976 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0dabb9-eaa9-4d53-9f57-44841d4f3b9c None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:07.661159 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 438/873] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:15:07.667127 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823b979-c60b-420d-9880-7778e080146f None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:07.777989 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823b979-c60b-420d-9880-7778e080146f None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:07.810067 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:07.827128 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff759da9-51d5-4f23-974f-769c0d7bcf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:07.827880 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff759da9-51d5-4f23-974f-769c0d7bcf40 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:07.828197 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff759da9-51d5-4f23-974f-769c0d7bcf40 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:07.828584 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff759da9-51d5-4f23-974f-769c0d7bcf40 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:07.837739 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff759da9-51d5-4f23-974f-769c0d7bcf40 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:07.839215 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff759da9-51d5-4f23-974f-769c0d7bcf40 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:07.851049 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-ff759da9-51d5-4f23-974f-769c0d7bcf40 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 16:15:07.851049 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:15:07.851049 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:15:07.851049 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:15:07.851049 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:15:07.851049 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:15:07.851049 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:15:07.851049 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:15:07.851049 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:15:07.851049 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:15:07.851049 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:15:07.851049 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:15:07.851049 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:15:07.851049 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:15:07.851049 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:15:07.851049 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:15:07.852205 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:15:07.852205 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:15:07.852205 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:15:07.852205 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:15:07.852205 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:15:07.852205 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:15:07.852205 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:15:07.852205 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:15:07.852205 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:15:07.852205 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:15:07.852205 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:15:07.852205 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:15:07.852205 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:15:07.852205 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:15:07.852205 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:15:07.852205 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:15:07.852205 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:15:07.852205 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:15:07.853508 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:15:07.853508 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:15:07.853508 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:15:07.853508 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:15:07.853508 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:15:07.853508 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:15:07.853508 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:15:07.853508 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:15:07.853508 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 16:15:07.853508 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:15:07.853508 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 436/874] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:15:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:15:07.859139 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0dabb9-eaa9-4d53-9f57-44841d4f3b9c None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:07.912711 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:07.968672 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0dabb9-eaa9-4d53-9f57-44841d4f3b9c None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:08.006851 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc53c2f-26f0-414f-a556-db9e5c8c9400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:08.007505 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc53c2f-26f0-414f-a556-db9e5c8c9400 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:08.007787 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc53c2f-26f0-414f-a556-db9e5c8c9400 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:08.008062 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc53c2f-26f0-414f-a556-db9e5c8c9400 None admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:08.008851 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc53c2f-26f0-414f-a556-db9e5c8c9400 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:15:08.009151 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc53c2f-26f0-414f-a556-db9e5c8c9400 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:08.010583 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc53c2f-26f0-414f-a556-db9e5c8c9400 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:08.032276 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 439/875] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Jul 27 16:15:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:15:08.038449 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff759da9-51d5-4f23-974f-769c0d7bcf40 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:08.151305 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff759da9-51d5-4f23-974f-769c0d7bcf40 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:08.193467 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f7a6d-f426-442f-a912-03c5afe6ba5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:08.194161 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f7a6d-f426-442f-a912-03c5afe6ba5f None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:08.194504 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f7a6d-f426-442f-a912-03c5afe6ba5f None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:08.194854 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f7a6d-f426-442f-a912-03c5afe6ba5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:08.257551 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:08.274865 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f7a6d-f426-442f-a912-03c5afe6ba5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:08.276906 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f7a6d-f426-442f-a912-03c5afe6ba5f None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:08.404867 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 437/876] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:15:08 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 16:15:08.407077 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc53c2f-26f0-414f-a556-db9e5c8c9400 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:08.515110 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc53c2f-26f0-414f-a556-db9e5c8c9400 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:08.526044 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:08.557052 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c6a2d-8212-4471-b708-15a28a11ddcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:08.557721 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c6a2d-8212-4471-b708-15a28a11ddcc None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:08.558005 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c6a2d-8212-4471-b708-15a28a11ddcc None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:08.558287 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c6a2d-8212-4471-b708-15a28a11ddcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:08.570676 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c6a2d-8212-4471-b708-15a28a11ddcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:08.572207 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c6a2d-8212-4471-b708-15a28a11ddcc None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:08.588987 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-eb4c6a2d-8212-4471-b708-15a28a11ddcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:15:08.588987 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:15:08.588987 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:15:08.588987 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:15:08.588987 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:15:08.588987 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:15:08.588987 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:15:08.588987 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:15:08.588987 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:15:08.588987 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:15:08.588987 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:15:08.588987 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:15:08.588987 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:15:08.588987 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:15:08.588987 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:15:08.590129 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:15:08.590129 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:15:08.590129 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:15:08.590129 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:15:08.590129 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:15:08.590129 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:15:08.590129 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:15:08.590129 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:15:08.590129 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:15:08.590129 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:15:08.590129 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:15:08.590129 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:15:08.590129 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:15:08.590129 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:15:08.590129 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:15:08.590129 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:15:08.590129 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:15:08.591326 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:15:08.591326 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:15:08.591326 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:15:08.591326 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:15:08.591326 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 440/877] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:15:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:15:08.596971 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f7a6d-f426-442f-a912-03c5afe6ba5f None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:08.694672 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:08.707616 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f7a6d-f426-442f-a912-03c5afe6ba5f None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:08.747297 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b39be-c730-4b80-ba00-a4fe4a222d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:08.747967 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b39be-c730-4b80-ba00-a4fe4a222d85 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:08.748253 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b39be-c730-4b80-ba00-a4fe4a222d85 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:08.748531 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b39be-c730-4b80-ba00-a4fe4a222d85 None admin] PATH_INFO: `/v3/domains` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:08.749242 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b39be-c730-4b80-ba00-a4fe4a222d85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:15:08.749550 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b39be-c730-4b80-ba00-a4fe4a222d85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:08.751654 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b39be-c730-4b80-ba00-a4fe4a222d85 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:08.764285 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 438/878] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:15:08.770169 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c6a2d-8212-4471-b708-15a28a11ddcc None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:08.872365 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c6a2d-8212-4471-b708-15a28a11ddcc None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:08.905938 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6dcca-3e6a-4cf8-8faa-45dcf3c46cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:08.906624 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6dcca-3e6a-4cf8-8faa-45dcf3c46cb8 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:08.906909 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6dcca-3e6a-4cf8-8faa-45dcf3c46cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:08.907187 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6dcca-3e6a-4cf8-8faa-45dcf3c46cb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:08.913832 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6dcca-3e6a-4cf8-8faa-45dcf3c46cb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:08.915296 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6dcca-3e6a-4cf8-8faa-45dcf3c46cb8 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:08.929083 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-bca6dcca-3e6a-4cf8-8faa-45dcf3c46cb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:15:08.929083 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:15:08.929083 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:15:08.929083 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:15:08.929083 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:15:08.929083 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:15:08.929083 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:15:08.929083 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:15:08.929083 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:15:08.929083 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:15:08.929083 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:15:08.929083 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:15:08.929083 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:15:08.929083 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:15:08.929083 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:15:08.930222 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:15:08.930222 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:15:08.930222 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:15:08.930222 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:15:08.930222 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:15:08.930222 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:15:08.930222 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:15:08.930222 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:15:08.930222 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:15:08.930222 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:15:08.930222 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:15:08.930222 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:15:08.930222 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:15:08.930222 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:15:08.930222 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:15:08.930222 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:15:08.930222 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:15:08.931544 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:15:08.931544 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:15:08.931544 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:15:08.931544 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:15:08.931544 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:15:08.931544 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:15:08.931544 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:15:08.931544 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:15:08.931544 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 441/879] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:15:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:15:08.936072 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b39be-c730-4b80-ba00-a4fe4a222d85 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:09.040677 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b39be-c730-4b80-ba00-a4fe4a222d85 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:09.075300 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d3f67-88a2-42b9-883d-a6afc83f166a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:09.075959 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d3f67-88a2-42b9-883d-a6afc83f166a None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:09.076239 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d3f67-88a2-42b9-883d-a6afc83f166a None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:09.076513 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d3f67-88a2-42b9-883d-a6afc83f166a None admin] PATH_INFO: `/v3/projects` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:09.077249 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d3f67-88a2-42b9-883d-a6afc83f166a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:15:09.077549 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d3f67-88a2-42b9-883d-a6afc83f166a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:09.079637 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d3f67-88a2-42b9-883d-a6afc83f166a None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:09.091942 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 439/880] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 16:15:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:15:09.098030 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6dcca-3e6a-4cf8-8faa-45dcf3c46cb8 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:09.119885 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:09.196615 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6dcca-3e6a-4cf8-8faa-45dcf3c46cb8 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:09.230443 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465341e5-01db-48e9-a1a3-e63b227c5a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:09.231062 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465341e5-01db-48e9-a1a3-e63b227c5a9b None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:09.231358 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465341e5-01db-48e9-a1a3-e63b227c5a9b None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:09.231671 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465341e5-01db-48e9-a1a3-e63b227c5a9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:09.232464 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465341e5-01db-48e9-a1a3-e63b227c5a9b None admin] RBAC: Adding query filter params (role.id=76e01abae9964dd5b28fc8895f739ee4, scope.project.id=73d63a3d7b724a5998ea2976430f242d, user.id=c311ccdc0d434bb6a9ef99da9a5404bf) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:15:09.232779 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465341e5-01db-48e9-a1a3-e63b227c5a9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:09.234239 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465341e5-01db-48e9-a1a3-e63b227c5a9b None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:09.239738 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 442/881] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 16:15:09 2022] GET /identity/v3/role_assignments?user.id=c311ccdc0d434bb6a9ef99da9a5404bf&scope.project.id=73d63a3d7b724a5998ea2976430f242d&role.id=76e01abae9964dd5b28fc8895f739ee4 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:15:11.469003 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffa64d-97aa-4b28-ace9-b0c9ccb39805 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:11.469573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffa64d-97aa-4b28-ace9-b0c9ccb39805 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:11.469573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffa64d-97aa-4b28-ace9-b0c9ccb39805 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:11.470907 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 440/882] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:15:11.476031 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148db9f5-5f02-4573-94df-d19ff1134e41 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:11.476442 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148db9f5-5f02-4573-94df-d19ff1134e41 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:11.476594 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148db9f5-5f02-4573-94df-d19ff1134e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:11.494607 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-148db9f5-5f02-4573-94df-d19ff1134e41 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:15:11.495836 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-148db9f5-5f02-4573-94df-d19ff1134e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:15:11.562433 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 443/883] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:15:11 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:15:11.586894 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffa64d-97aa-4b28-ace9-b0c9ccb39805 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:11.598005 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:11.691576 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffa64d-97aa-4b28-ace9-b0c9ccb39805 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:11.724763 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a96592-e3ba-4aa8-a66d-51ba7b56c4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:11.725342 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a96592-e3ba-4aa8-a66d-51ba7b56c4a2 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:11.725694 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a96592-e3ba-4aa8-a66d-51ba7b56c4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:11.725986 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a96592-e3ba-4aa8-a66d-51ba7b56c4a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:11.737315 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a96592-e3ba-4aa8-a66d-51ba7b56c4a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:15:11.742279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-34a96592-e3ba-4aa8-a66d-51ba7b56c4a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:15:11.742279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:15:11.742279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:15:11.742279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:15:11.742279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:15:11.742279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:15:11.742279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:15:11.742279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:15:11.742279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:15:11.742279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:15:11.742279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:15:11.742279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:15:11.742279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:15:11.742279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:15:11.742279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:15:11.742279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:15:11.743680 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:15:11.743680 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:15:11.743680 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:15:11.743680 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:15:11.743680 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:15:11.743680 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:15:11.743680 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:15:11.743680 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:15:11.743680 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:15:11.743680 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:15:11.743680 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:15:11.743680 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:15:11.743680 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:15:11.743680 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:15:11.743680 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:15:11.743680 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:15:11.745284 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:15:11.745284 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:15:11.745284 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:15:11.745284 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:15:11.745284 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:15:11.745284 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:15:11.745284 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:15:11.745284 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:15:11.745284 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:15:11.745284 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:15:11.745284 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:15:11.745284 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:15:11.745284 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 441/884] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 16:15:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:15:11.749600 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148db9f5-5f02-4573-94df-d19ff1134e41 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:11.765242 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:11.849181 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148db9f5-5f02-4573-94df-d19ff1134e41 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:11.883068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029a603-94ec-4f08-b281-45b2cda2e214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:11.883720 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029a603-94ec-4f08-b281-45b2cda2e214 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:11.884012 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029a603-94ec-4f08-b281-45b2cda2e214 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:11.884294 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029a603-94ec-4f08-b281-45b2cda2e214 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:11.885011 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029a603-94ec-4f08-b281-45b2cda2e214 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:15:11.885323 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029a603-94ec-4f08-b281-45b2cda2e214 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:11.886715 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029a603-94ec-4f08-b281-45b2cda2e214 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:11.894963 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 444/885] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:15:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:15:11.900837 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a96592-e3ba-4aa8-a66d-51ba7b56c4a2 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:11.969608 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:12.002777 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a96592-e3ba-4aa8-a66d-51ba7b56c4a2 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:12.037159 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd539a6-7298-4760-a65e-9003c0d2313d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:12.037809 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd539a6-7298-4760-a65e-9003c0d2313d None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:12.038092 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd539a6-7298-4760-a65e-9003c0d2313d None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:12.038373 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd539a6-7298-4760-a65e-9003c0d2313d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:12.049162 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd539a6-7298-4760-a65e-9003c0d2313d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:12.050623 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd539a6-7298-4760-a65e-9003c0d2313d None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:12.066492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-9cd539a6-7298-4760-a65e-9003c0d2313d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:15:12.066492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:15:12.066492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:15:12.066492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:15:12.066492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:15:12.066492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:15:12.066492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:15:12.066492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:15:12.066492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:15:12.066492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:15:12.066492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:15:12.066492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:15:12.066492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:15:12.066492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:15:12.066492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:15:12.067629 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:15:12.067629 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:15:12.067629 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:15:12.067629 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:15:12.067629 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:15:12.067629 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:15:12.067629 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:15:12.067629 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:15:12.067629 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:15:12.067629 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:15:12.067629 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:15:12.067629 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:15:12.067629 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:15:12.067629 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:15:12.067629 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:15:12.067629 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:15:12.067629 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:15:12.068996 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:15:12.068996 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:15:12.068996 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:15:12.068996 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:15:12.068996 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 442/886] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:15:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:15:12.073435 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029a603-94ec-4f08-b281-45b2cda2e214 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:12.150142 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:12.173146 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029a603-94ec-4f08-b281-45b2cda2e214 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:12.207712 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12458b59-1a79-434a-b64f-615c4037c00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:12.208335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12458b59-1a79-434a-b64f-615c4037c00d None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:12.208626 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12458b59-1a79-434a-b64f-615c4037c00d None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:12.208909 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12458b59-1a79-434a-b64f-615c4037c00d None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:12.209605 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12458b59-1a79-434a-b64f-615c4037c00d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:15:12.209914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12458b59-1a79-434a-b64f-615c4037c00d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:12.211299 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12458b59-1a79-434a-b64f-615c4037c00d None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:12.224163 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 445/887] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:15:12.230316 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd539a6-7298-4760-a65e-9003c0d2313d None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:12.332159 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd539a6-7298-4760-a65e-9003c0d2313d None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:12.353154 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:12.370638 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a64c8-446f-4d4c-95cd-2702175a3014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:12.371630 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a64c8-446f-4d4c-95cd-2702175a3014 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:12.371765 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a64c8-446f-4d4c-95cd-2702175a3014 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:12.371994 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a64c8-446f-4d4c-95cd-2702175a3014 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:12.382150 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a64c8-446f-4d4c-95cd-2702175a3014 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:12.383874 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a64c8-446f-4d4c-95cd-2702175a3014 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:12.397615 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-880a64c8-446f-4d4c-95cd-2702175a3014 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 16:15:12.397615 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:15:12.397615 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:15:12.397615 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:15:12.397615 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:15:12.397615 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:15:12.397615 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:15:12.397615 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:15:12.397615 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:15:12.397615 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:15:12.397615 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:15:12.397615 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:15:12.397615 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:15:12.397615 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:15:12.397615 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:15:12.397615 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:15:12.398770 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:15:12.398770 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:15:12.398770 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:15:12.398770 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:15:12.398770 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:15:12.398770 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:15:12.398770 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:15:12.398770 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:15:12.398770 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:15:12.398770 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:15:12.398770 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:15:12.398770 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:15:12.398770 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:15:12.398770 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:15:12.398770 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:15:12.398770 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:15:12.398770 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:15:12.398770 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:15:12.400110 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:15:12.400110 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:15:12.400110 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:15:12.400110 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:15:12.400110 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:15:12.400110 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:15:12.400110 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:15:12.400110 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:15:12.400110 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 16:15:12.400110 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:15:12.400110 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 443/888] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:15:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:15:12.404521 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12458b59-1a79-434a-b64f-615c4037c00d None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:12.512104 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12458b59-1a79-434a-b64f-615c4037c00d None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:12.550737 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad990d3-c2ca-4428-8151-32117c064c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:12.551400 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad990d3-c2ca-4428-8151-32117c064c72 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:12.551703 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad990d3-c2ca-4428-8151-32117c064c72 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:12.551984 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad990d3-c2ca-4428-8151-32117c064c72 None admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:12.552807 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad990d3-c2ca-4428-8151-32117c064c72 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:15:12.553123 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad990d3-c2ca-4428-8151-32117c064c72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:12.554607 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad990d3-c2ca-4428-8151-32117c064c72 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:12.557791 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:12.576071 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 446/889] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Jul 27 16:15:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:15:12.582088 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a64c8-446f-4d4c-95cd-2702175a3014 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:12.691365 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a64c8-446f-4d4c-95cd-2702175a3014 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:12.726879 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b420520-a1c0-425a-9487-72e74e17fe50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:12.727563 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b420520-a1c0-425a-9487-72e74e17fe50 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:12.727847 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b420520-a1c0-425a-9487-72e74e17fe50 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:12.728132 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b420520-a1c0-425a-9487-72e74e17fe50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:12.740270 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b420520-a1c0-425a-9487-72e74e17fe50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:12.742869 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b420520-a1c0-425a-9487-72e74e17fe50 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:12.759597 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-3b420520-a1c0-425a-9487-72e74e17fe50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:15:12.759597 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:15:12.759597 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:15:12.759597 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:15:12.759597 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:15:12.759597 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:15:12.759597 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:15:12.759597 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:15:12.759597 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:15:12.759597 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:15:12.759597 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:15:12.759597 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:15:12.759597 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:15:12.759597 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:15:12.759597 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:15:12.761339 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:15:12.761339 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:15:12.761339 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:15:12.761339 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:15:12.761339 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:15:12.761339 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:15:12.761339 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:15:12.761339 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:15:12.761339 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:15:12.761339 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:15:12.761339 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:15:12.761339 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:15:12.761339 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:15:12.761339 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:15:12.761339 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:15:12.761339 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:15:12.761339 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:15:12.763395 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:15:12.763395 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:15:12.763395 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:15:12.763395 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:15:12.763395 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 444/890] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:15:12.766973 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad990d3-c2ca-4428-8151-32117c064c72 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:12.869209 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad990d3-c2ca-4428-8151-32117c064c72 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:12.902451 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687e859-0b78-4a95-a7d0-8ea2a759a361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:12.903161 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687e859-0b78-4a95-a7d0-8ea2a759a361 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:12.903514 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687e859-0b78-4a95-a7d0-8ea2a759a361 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:12.903888 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687e859-0b78-4a95-a7d0-8ea2a759a361 None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:12.904617 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687e859-0b78-4a95-a7d0-8ea2a759a361 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:15:12.904948 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687e859-0b78-4a95-a7d0-8ea2a759a361 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:12.906445 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687e859-0b78-4a95-a7d0-8ea2a759a361 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:12.919032 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 447/891] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:15:12.925569 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b420520-a1c0-425a-9487-72e74e17fe50 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:12.956067 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:13.023783 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b420520-a1c0-425a-9487-72e74e17fe50 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:13.057683 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa752f2-04fa-4dc0-85c0-7645a6ffa0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:13.058318 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa752f2-04fa-4dc0-85c0-7645a6ffa0cf None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:13.058598 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa752f2-04fa-4dc0-85c0-7645a6ffa0cf None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:13.058873 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa752f2-04fa-4dc0-85c0-7645a6ffa0cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:13.066361 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa752f2-04fa-4dc0-85c0-7645a6ffa0cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:13.067842 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa752f2-04fa-4dc0-85c0-7645a6ffa0cf None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:13.079991 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-3fa752f2-04fa-4dc0-85c0-7645a6ffa0cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:15:13.079991 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:15:13.079991 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:15:13.079991 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:15:13.079991 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:15:13.079991 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:15:13.079991 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:15:13.079991 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:15:13.079991 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:15:13.079991 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:15:13.079991 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:15:13.079991 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:15:13.079991 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:15:13.079991 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:15:13.079991 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:15:13.081559 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:15:13.081559 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:15:13.081559 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:15:13.081559 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:15:13.081559 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:15:13.081559 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:15:13.081559 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:15:13.081559 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:15:13.081559 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:15:13.081559 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:15:13.081559 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:15:13.081559 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:15:13.081559 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:15:13.081559 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:15:13.081559 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:15:13.081559 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:15:13.081559 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:15:13.082487 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:15:13.082487 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:15:13.082487 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:15:13.082487 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:15:13.082487 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:15:13.082487 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:15:13.082487 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:15:13.082487 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:15:13.082487 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 445/892] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:15:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:15:13.087079 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687e859-0b78-4a95-a7d0-8ea2a759a361 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:13.143050 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:13.188633 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687e859-0b78-4a95-a7d0-8ea2a759a361 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:13.222139 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19641c7b-5e72-4fe2-96d6-32460855602b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:13.222766 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19641c7b-5e72-4fe2-96d6-32460855602b None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:13.223053 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19641c7b-5e72-4fe2-96d6-32460855602b None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:13.223329 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19641c7b-5e72-4fe2-96d6-32460855602b None admin] PATH_INFO: `/v3/projects` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:13.224117 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19641c7b-5e72-4fe2-96d6-32460855602b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:15:13.224431 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19641c7b-5e72-4fe2-96d6-32460855602b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:13.225874 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19641c7b-5e72-4fe2-96d6-32460855602b None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:13.238512 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 448/893] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 16:15:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:15:13.244542 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa752f2-04fa-4dc0-85c0-7645a6ffa0cf None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:13.340001 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:13.350104 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa752f2-04fa-4dc0-85c0-7645a6ffa0cf None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:13.386654 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2d10e-fef9-4171-bb16-de7331c7a4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:13.387331 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2d10e-fef9-4171-bb16-de7331c7a4aa None admin] REQUEST_METHOD: `PUT` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:13.387642 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2d10e-fef9-4171-bb16-de7331c7a4aa None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:13.387920 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2d10e-fef9-4171-bb16-de7331c7a4aa None admin] PATH_INFO: `/v3/projects/73d63a3d7b724a5998ea2976430f242d/users/c311ccdc0d434bb6a9ef99da9a5404bf/roles/76e01abae9964dd5b28fc8895f739ee4` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:13.389840 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2d10e-fef9-4171-bb16-de7331c7a4aa None admin] RBAC: Authorizing `identity:create_grant(project_id=73d63a3d7b724a5998ea2976430f242d, user_id=c311ccdc0d434bb6a9ef99da9a5404bf, role_id=76e01abae9964dd5b28fc8895f739ee4)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:13.391305 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2d10e-fef9-4171-bb16-de7331c7a4aa None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:13.404172 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 446/894] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 16:15:13 2022] PUT /identity/v3/projects/73d63a3d7b724a5998ea2976430f242d/users/c311ccdc0d434bb6a9ef99da9a5404bf/roles/76e01abae9964dd5b28fc8895f739ee4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:15:15.645011 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af402b1-c6fd-4fd4-a779-6c105da25ace None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:15.645539 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af402b1-c6fd-4fd4-a779-6c105da25ace None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:15.645539 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af402b1-c6fd-4fd4-a779-6c105da25ace None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:15.646912 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 449/895] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:15:15.652182 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66c07d-13f5-4c4e-924f-4306d58dbb64 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:15.652588 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66c07d-13f5-4c4e-924f-4306d58dbb64 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:15.652740 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66c07d-13f5-4c4e-924f-4306d58dbb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:15.671605 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-2c66c07d-13f5-4c4e-924f-4306d58dbb64 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:15:15.672798 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-2c66c07d-13f5-4c4e-924f-4306d58dbb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:15:15.740316 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 447/896] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:15:15 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:15:15.764057 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af402b1-c6fd-4fd4-a779-6c105da25ace None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:15.863012 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af402b1-c6fd-4fd4-a779-6c105da25ace None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:15.877232 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:15.897567 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779188bc-075d-4f2b-8567-9150aacbf018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:15.898138 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779188bc-075d-4f2b-8567-9150aacbf018 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:15.898421 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779188bc-075d-4f2b-8567-9150aacbf018 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:15.898692 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779188bc-075d-4f2b-8567-9150aacbf018 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:15.908629 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779188bc-075d-4f2b-8567-9150aacbf018 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:15:15.913483 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-779188bc-075d-4f2b-8567-9150aacbf018 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:15:15.913483 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:15:15.913483 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:15:15.913483 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:15:15.913483 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:15:15.913483 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:15:15.913483 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:15:15.913483 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:15:15.913483 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:15:15.913483 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:15:15.913483 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:15:15.913483 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:15:15.913483 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:15:15.913483 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:15:15.913483 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:15:15.913483 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:15:15.914779 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:15:15.914779 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:15:15.914779 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:15:15.914779 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:15:15.914779 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:15:15.914779 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:15:15.914779 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:15:15.914779 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:15:15.914779 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:15:15.914779 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:15:15.914779 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:15:15.914779 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:15:15.914779 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:15:15.914779 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:15:15.914779 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:15:15.914779 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:15:15.916808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:15:15.916808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:15:15.916808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:15:15.916808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:15:15.916808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:15:15.916808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:15:15.916808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:15:15.916808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:15:15.916808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:15:15.916808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:15:15.916808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:15:15.916808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:15:15.916808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 450/897] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 16:15:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:15:15.921189 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66c07d-13f5-4c4e-924f-4306d58dbb64 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:16.002605 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:16.021583 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66c07d-13f5-4c4e-924f-4306d58dbb64 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:16.054295 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e346d1-f1b2-498f-9fc7-e581911e43e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:16.054901 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e346d1-f1b2-498f-9fc7-e581911e43e1 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:16.055181 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e346d1-f1b2-498f-9fc7-e581911e43e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:16.055495 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e346d1-f1b2-498f-9fc7-e581911e43e1 None admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:16.056197 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e346d1-f1b2-498f-9fc7-e581911e43e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:15:16.056499 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e346d1-f1b2-498f-9fc7-e581911e43e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:16.057846 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e346d1-f1b2-498f-9fc7-e581911e43e1 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:16.066136 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 448/898] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 16:15:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:15:16.071878 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779188bc-075d-4f2b-8567-9150aacbf018 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:16.169031 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779188bc-075d-4f2b-8567-9150aacbf018 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:16.202295 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e902e61-80a8-40d8-ab69-5eaa6e059ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:16.202934 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e902e61-80a8-40d8-ab69-5eaa6e059ab3 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:16.203216 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e902e61-80a8-40d8-ab69-5eaa6e059ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:16.203549 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e902e61-80a8-40d8-ab69-5eaa6e059ab3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:16.213503 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e902e61-80a8-40d8-ab69-5eaa6e059ab3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:16.214969 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e902e61-80a8-40d8-ab69-5eaa6e059ab3 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:16.232447 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-2e902e61-80a8-40d8-ab69-5eaa6e059ab3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:15:16.232447 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:15:16.232447 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:15:16.232447 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:15:16.232447 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:15:16.232447 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:15:16.232447 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:15:16.232447 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:15:16.232447 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:15:16.232447 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:15:16.232447 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:15:16.232447 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:15:16.232447 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:15:16.232447 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:15:16.232447 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:15:16.233557 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:15:16.233557 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:15:16.233557 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:15:16.233557 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:15:16.233557 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:15:16.233557 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:15:16.233557 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:15:16.233557 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:15:16.233557 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:15:16.233557 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:15:16.233557 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:15:16.233557 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:15:16.233557 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:15:16.233557 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:15:16.233557 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:15:16.233557 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:15:16.233557 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:15:16.239796 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:15:16.239796 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:15:16.239796 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:15:16.239796 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:15:16.239796 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 451/899] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:15:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:15:16.240131 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e346d1-f1b2-498f-9fc7-e581911e43e1 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:16.342734 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e346d1-f1b2-498f-9fc7-e581911e43e1 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:16.384567 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd60210-5fec-424d-a6d5-9821a97440c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:16.385336 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd60210-5fec-424d-a6d5-9821a97440c6 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:16.385987 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd60210-5fec-424d-a6d5-9821a97440c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:16.386356 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd60210-5fec-424d-a6d5-9821a97440c6 None admin] PATH_INFO: `/v3/domains` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:16.387338 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd60210-5fec-424d-a6d5-9821a97440c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:15:16.387802 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd60210-5fec-424d-a6d5-9821a97440c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:16.389747 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd60210-5fec-424d-a6d5-9821a97440c6 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:16.403575 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 449/900] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:15:16.409191 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e902e61-80a8-40d8-ab69-5eaa6e059ab3 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:16.437643 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:16.509407 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e902e61-80a8-40d8-ab69-5eaa6e059ab3 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:16.541618 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774d9ba-fe14-4ff8-acc2-8e072d8fa3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:16.542242 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774d9ba-fe14-4ff8-acc2-8e072d8fa3d8 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:16.542523 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774d9ba-fe14-4ff8-acc2-8e072d8fa3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:16.542798 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774d9ba-fe14-4ff8-acc2-8e072d8fa3d8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:16.550962 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774d9ba-fe14-4ff8-acc2-8e072d8fa3d8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:16.552442 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774d9ba-fe14-4ff8-acc2-8e072d8fa3d8 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:16.564311 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-a774d9ba-fe14-4ff8-acc2-8e072d8fa3d8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 16:15:16.564311 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:15:16.564311 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:15:16.564311 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:15:16.564311 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:15:16.564311 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:15:16.564311 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:15:16.564311 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:15:16.564311 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:15:16.564311 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:15:16.564311 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:15:16.564311 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:15:16.564311 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:15:16.564311 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:15:16.564311 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:15:16.564311 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:15:16.565662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:15:16.565662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:15:16.565662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:15:16.565662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:15:16.565662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:15:16.565662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:15:16.565662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:15:16.565662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:15:16.565662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:15:16.565662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:15:16.565662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:15:16.565662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:15:16.565662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:15:16.565662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:15:16.565662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:15:16.565662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:15:16.565662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:15:16.565662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:15:16.567892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:15:16.567892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:15:16.567892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:15:16.567892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:15:16.567892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:15:16.567892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:15:16.567892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:15:16.567892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:15:16.567892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 16:15:16.567892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:15:16.567892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 452/901] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:15:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:15:16.571888 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd60210-5fec-424d-a6d5-9821a97440c6 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:16.575897 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:16.671959 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd60210-5fec-424d-a6d5-9821a97440c6 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:16.707597 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e69672-045d-49cc-8e52-b582c79d132c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:16.708146 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e69672-045d-49cc-8e52-b582c79d132c None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:16.708429 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e69672-045d-49cc-8e52-b582c79d132c None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:16.708706 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e69672-045d-49cc-8e52-b582c79d132c None admin] PATH_INFO: `/v3/users` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:16.709488 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e69672-045d-49cc-8e52-b582c79d132c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:15:16.709795 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e69672-045d-49cc-8e52-b582c79d132c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:16.711204 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e69672-045d-49cc-8e52-b582c79d132c None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:16.728298 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 450/902] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Jul 27 16:15:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:15:16.734204 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774d9ba-fe14-4ff8-acc2-8e072d8fa3d8 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:16.817353 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:16.832142 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774d9ba-fe14-4ff8-acc2-8e072d8fa3d8 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:16.866236 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3deb4-d5b2-4fbd-bff7-71069e02f0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:16.866854 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3deb4-d5b2-4fbd-bff7-71069e02f0d1 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:16.867143 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3deb4-d5b2-4fbd-bff7-71069e02f0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:16.867451 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3deb4-d5b2-4fbd-bff7-71069e02f0d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:16.933126 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3deb4-d5b2-4fbd-bff7-71069e02f0d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:16.934571 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3deb4-d5b2-4fbd-bff7-71069e02f0d1 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:17.014108 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:17.029660 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 453/903] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 16:15:16 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 16:15:17.036235 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e69672-045d-49cc-8e52-b582c79d132c None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:17.096517 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:17.134729 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e69672-045d-49cc-8e52-b582c79d132c None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:17.168940 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f5138-c476-4d12-8c73-08f47ce5cf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:17.169589 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f5138-c476-4d12-8c73-08f47ce5cf7f None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:17.169874 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f5138-c476-4d12-8c73-08f47ce5cf7f None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:17.170399 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f5138-c476-4d12-8c73-08f47ce5cf7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:17.180552 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f5138-c476-4d12-8c73-08f47ce5cf7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:17.181996 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f5138-c476-4d12-8c73-08f47ce5cf7f None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:17.196701 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-ca0f5138-c476-4d12-8c73-08f47ce5cf7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:15:17.196701 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:15:17.196701 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:15:17.196701 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:15:17.196701 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:15:17.196701 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:15:17.196701 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:15:17.196701 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:15:17.196701 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:15:17.196701 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:15:17.196701 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:15:17.196701 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:15:17.196701 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:15:17.196701 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:15:17.196701 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:15:17.197574 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:15:17.197574 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:15:17.197574 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:15:17.197574 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:15:17.197574 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:15:17.197574 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:15:17.197574 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:15:17.197574 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:15:17.197574 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:15:17.197574 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:15:17.197574 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:15:17.197574 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:15:17.197574 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:15:17.197574 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:15:17.197574 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:15:17.197574 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:15:17.197574 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:15:17.198479 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:15:17.198479 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:15:17.198479 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:15:17.198479 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:15:17.198479 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 451/904] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:15:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:15:17.204746 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3deb4-d5b2-4fbd-bff7-71069e02f0d1 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:17.306244 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3deb4-d5b2-4fbd-bff7-71069e02f0d1 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:17.342931 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef8aa8-f239-41b9-a3bb-76d8f85ba6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:17.343579 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef8aa8-f239-41b9-a3bb-76d8f85ba6e5 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:17.343866 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef8aa8-f239-41b9-a3bb-76d8f85ba6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:17.344205 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef8aa8-f239-41b9-a3bb-76d8f85ba6e5 None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:17.344890 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef8aa8-f239-41b9-a3bb-76d8f85ba6e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:15:17.345199 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef8aa8-f239-41b9-a3bb-76d8f85ba6e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:17.346578 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef8aa8-f239-41b9-a3bb-76d8f85ba6e5 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:17.357515 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 454/905] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 16:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:15:17.363247 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f5138-c476-4d12-8c73-08f47ce5cf7f None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:17.460649 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f5138-c476-4d12-8c73-08f47ce5cf7f None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:17.473859 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:17.494541 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577659b1-1729-43d8-b95e-ad88b8549cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:17.495103 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577659b1-1729-43d8-b95e-ad88b8549cd9 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:17.495432 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577659b1-1729-43d8-b95e-ad88b8549cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:17.495719 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577659b1-1729-43d8-b95e-ad88b8549cd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:17.502833 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577659b1-1729-43d8-b95e-ad88b8549cd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:17.504315 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577659b1-1729-43d8-b95e-ad88b8549cd9 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:17.517098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application [None req-577659b1-1729-43d8-b95e-ad88b8549cd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:15:17.517098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:15:17.517098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:15:17.517098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:15:17.517098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:15:17.517098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:15:17.517098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:15:17.517098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:15:17.517098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:15:17.517098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:15:17.517098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:15:17.517098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:15:17.517098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:15:17.517098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:15:17.517098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:15:17.518134 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:15:17.518134 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:15:17.518134 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:15:17.518134 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:15:17.518134 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:15:17.518134 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:15:17.518134 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:15:17.518134 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:15:17.518134 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application with Lock( Jul 27 16:15:17.518134 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:15:17.518134 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:15:17.518134 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:15:17.518134 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:15:17.518134 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:15:17.518134 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:15:17.518134 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:15:17.518134 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:15:17.519217 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:15:17.519217 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:15:17.519217 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:15:17.519217 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:15:17.519217 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:15:17.519217 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:15:17.519217 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:15:17.519217 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: ERROR keystone.server.flask.application Jul 27 16:15:17.519217 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 452/906] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 16:15:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:15:17.524454 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef8aa8-f239-41b9-a3bb-76d8f85ba6e5 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:17.572265 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:17.623608 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef8aa8-f239-41b9-a3bb-76d8f85ba6e5 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:17.656192 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d068a64-39ad-4edc-a636-456a05019da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:17.656859 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d068a64-39ad-4edc-a636-456a05019da5 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:17.657141 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d068a64-39ad-4edc-a636-456a05019da5 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:17.657418 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d068a64-39ad-4edc-a636-456a05019da5 None admin] PATH_INFO: `/v3/projects` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:17.658150 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d068a64-39ad-4edc-a636-456a05019da5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:15:17.658454 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d068a64-39ad-4edc-a636-456a05019da5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:17.659930 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d068a64-39ad-4edc-a636-456a05019da5 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:17.673181 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 455/907] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 16:15:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:15:17.679194 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577659b1-1729-43d8-b95e-ad88b8549cd9 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:17.779677 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577659b1-1729-43d8-b95e-ad88b8549cd9 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:17.812885 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89bbbd1-d768-4e93-9b22-4fc73b929cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:17.813989 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bbbd1-d768-4e93-9b22-4fc73b929cac None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:17.814270 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bbbd1-d768-4e93-9b22-4fc73b929cac None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:17.814543 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bbbd1-d768-4e93-9b22-4fc73b929cac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:17.815313 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89bbbd1-d768-4e93-9b22-4fc73b929cac None admin] RBAC: Adding query filter params (role.id=76e01abae9964dd5b28fc8895f739ee4, scope.project.id=73d63a3d7b724a5998ea2976430f242d, user.id=c311ccdc0d434bb6a9ef99da9a5404bf) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:15:17.815730 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89bbbd1-d768-4e93-9b22-4fc73b929cac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:17.817170 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89bbbd1-d768-4e93-9b22-4fc73b929cac None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:17.823337 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 453/908] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 16:15:17 2022] GET /identity/v3/role_assignments?user.id=c311ccdc0d434bb6a9ef99da9a5404bf&scope.project.id=73d63a3d7b724a5998ea2976430f242d&role.id=76e01abae9964dd5b28fc8895f739ee4 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:15:20.065563 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150698c5-79cc-4fc3-97de-8915d571da6c None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:20.066101 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150698c5-79cc-4fc3-97de-8915d571da6c None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:20.066101 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150698c5-79cc-4fc3-97de-8915d571da6c None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:20.067480 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 456/909] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:15:20.072551 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7aed99-4c3a-4a43-850a-e498aebaed3b None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:20.072990 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7aed99-4c3a-4a43-850a-e498aebaed3b None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:20.073119 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7aed99-4c3a-4a43-850a-e498aebaed3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:20.091427 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-6b7aed99-4c3a-4a43-850a-e498aebaed3b None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:15:20.092617 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-6b7aed99-4c3a-4a43-850a-e498aebaed3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:15:20.121610 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:20.159613 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 454/910] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:15:20 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:15:20.183291 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150698c5-79cc-4fc3-97de-8915d571da6c None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:20.284572 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150698c5-79cc-4fc3-97de-8915d571da6c None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:20.291749 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:20.319319 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc6d3e-bcd5-4aa3-b23e-dc425408cc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:20.320061 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc6d3e-bcd5-4aa3-b23e-dc425408cc99 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:20.320398 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc6d3e-bcd5-4aa3-b23e-dc425408cc99 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:20.320720 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc6d3e-bcd5-4aa3-b23e-dc425408cc99 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:20.321457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc6d3e-bcd5-4aa3-b23e-dc425408cc99 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:20.323032 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc6d3e-bcd5-4aa3-b23e-dc425408cc99 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:20.334205 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-69fc6d3e-bcd5-4aa3-b23e-dc425408cc99 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 16:15:20.334205 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:15:20.334205 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:15:20.334205 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:15:20.334205 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:15:20.334205 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:15:20.334205 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:15:20.334205 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:15:20.334205 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 16:15:20.334205 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:15:20.334205 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:15:20.334205 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:15:20.334205 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:15:20.334205 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:15:20.334205 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:15:20.334205 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:15:20.334205 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:15:20.335474 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:15:20.335474 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:15:20.335474 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:15:20.335474 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:15:20.335474 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:15:20.335474 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:15:20.335474 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:15:20.335474 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:15:20.335474 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:15:20.335474 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:15:20.335474 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:15:20.335474 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:15:20.335474 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:15:20.335474 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:15:20.335474 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:15:20.335474 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:15:20.336469 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:15:20.336469 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:15:20.336469 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:15:20.336469 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:15:20.336469 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:15:20.336469 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:15:20.336469 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:15:20.336469 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:15:20.336469 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:15:20.336469 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:15:20.336469 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:15:20.336469 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:15:20.336469 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 16:15:20.336469 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:15:20.336469 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 457/911] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Jul 27 16:15:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:15:20.342166 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7aed99-4c3a-4a43-850a-e498aebaed3b None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:20.446653 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7aed99-4c3a-4a43-850a-e498aebaed3b None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:20.479708 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5dd84-0908-4f60-a1f3-80af1baa8c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:20.480316 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5dd84-0908-4f60-a1f3-80af1baa8c51 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:20.480596 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5dd84-0908-4f60-a1f3-80af1baa8c51 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:20.480868 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5dd84-0908-4f60-a1f3-80af1baa8c51 None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:20.481528 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5dd84-0908-4f60-a1f3-80af1baa8c51 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:15:20.481829 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5dd84-0908-4f60-a1f3-80af1baa8c51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:20.483274 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5dd84-0908-4f60-a1f3-80af1baa8c51 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:20.487959 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 455/912] 10.222.0.65 () {56 vars in 1116 bytes} [Wed Jul 27 16:15:20 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:15:20.493775 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc6d3e-bcd5-4aa3-b23e-dc425408cc99 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:20.594945 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc6d3e-bcd5-4aa3-b23e-dc425408cc99 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:20.628437 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6586c74-8716-4619-981e-008c08b7a4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:20.629053 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6586c74-8716-4619-981e-008c08b7a4d1 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:20.629343 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6586c74-8716-4619-981e-008c08b7a4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:20.629622 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6586c74-8716-4619-981e-008c08b7a4d1 None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:20.630307 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6586c74-8716-4619-981e-008c08b7a4d1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:15:20.630616 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6586c74-8716-4619-981e-008c08b7a4d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:20.632026 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6586c74-8716-4619-981e-008c08b7a4d1 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:20.636393 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 458/913] 10.222.0.65 () {56 vars in 1116 bytes} [Wed Jul 27 16:15:20 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:15:22.868379 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f58b1-967e-440b-8488-47075579dc90 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:22.868903 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f58b1-967e-440b-8488-47075579dc90 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:22.868903 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f58b1-967e-440b-8488-47075579dc90 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:22.870266 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 456/914] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:15:22.875857 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac206e-e183-4fb2-820f-6efd9af950ba None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:22.876233 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac206e-e183-4fb2-820f-6efd9af950ba None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:22.876431 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac206e-e183-4fb2-820f-6efd9af950ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:22.894630 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-c6ac206e-e183-4fb2-820f-6efd9af950ba None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:15:22.895849 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-c6ac206e-e183-4fb2-820f-6efd9af950ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:15:22.924460 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:22.964611 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 459/915] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:15:22 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:15:22.988419 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f58b1-967e-440b-8488-47075579dc90 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:23.020840 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:23.091023 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f58b1-967e-440b-8488-47075579dc90 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:23.124619 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41443743-e693-4e82-8711-2e5bc661ae01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:23.125237 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41443743-e693-4e82-8711-2e5bc661ae01 None admin] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:23.126099 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41443743-e693-4e82-8711-2e5bc661ae01 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:23.126382 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41443743-e693-4e82-8711-2e5bc661ae01 None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:23.127083 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41443743-e693-4e82-8711-2e5bc661ae01 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:23.128482 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41443743-e693-4e82-8711-2e5bc661ae01 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:23.142683 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 457/916] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 16:15:22 2022] POST /identity/v3/services => generated 246 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:15:25.375243 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aeb655-18e0-4d61-867b-42ffcd42ed90 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:25.375823 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aeb655-18e0-4d61-867b-42ffcd42ed90 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:25.375914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aeb655-18e0-4d61-867b-42ffcd42ed90 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:25.377229 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 460/917] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:15:25.382241 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405261e-61f9-4b37-918b-b3e4f23aa922 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:25.382647 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405261e-61f9-4b37-918b-b3e4f23aa922 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:25.382796 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405261e-61f9-4b37-918b-b3e4f23aa922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:25.400930 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-a405261e-61f9-4b37-918b-b3e4f23aa922 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:15:25.402099 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-a405261e-61f9-4b37-918b-b3e4f23aa922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:15:25.476045 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 458/918] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:15:25 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:15:25.499074 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aeb655-18e0-4d61-867b-42ffcd42ed90 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:25.597323 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aeb655-18e0-4d61-867b-42ffcd42ed90 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:25.629785 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786436b-bbd4-4d29-8256-1a0aa3aa2848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:25.630347 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786436b-bbd4-4d29-8256-1a0aa3aa2848 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:25.630627 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786436b-bbd4-4d29-8256-1a0aa3aa2848 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:25.630907 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786436b-bbd4-4d29-8256-1a0aa3aa2848 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:25.631555 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786436b-bbd4-4d29-8256-1a0aa3aa2848 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:25.632919 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786436b-bbd4-4d29-8256-1a0aa3aa2848 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:25.642109 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-9786436b-bbd4-4d29-8256-1a0aa3aa2848 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 16:15:25.642109 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:15:25.642109 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:15:25.642109 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:15:25.642109 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:15:25.642109 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:15:25.642109 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:15:25.642109 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:15:25.642109 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 16:15:25.642109 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:15:25.642109 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:15:25.642109 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:15:25.642109 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:15:25.642109 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:15:25.642109 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:15:25.642109 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:15:25.642109 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:15:25.643240 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:15:25.643240 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:15:25.643240 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:15:25.643240 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:15:25.643240 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:15:25.643240 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:15:25.643240 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:15:25.643240 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:15:25.643240 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:15:25.643240 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:15:25.643240 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:15:25.643240 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:15:25.643240 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:15:25.643240 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:15:25.643240 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:15:25.643240 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:15:25.644114 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:15:25.644114 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:15:25.644114 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:15:25.644114 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:15:25.644114 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:15:25.644114 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:15:25.644114 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:15:25.644114 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:15:25.644114 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:15:25.644114 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:15:25.644114 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:15:25.644114 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:15:25.644114 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 16:15:25.644114 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:15:25.644114 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 461/919] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Jul 27 16:15:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:15:25.649299 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405261e-61f9-4b37-918b-b3e4f23aa922 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:25.667283 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:25.748796 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405261e-61f9-4b37-918b-b3e4f23aa922 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:25.783212 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b5760-98e4-469f-886d-c5ed76cf1006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:25.783985 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b5760-98e4-469f-886d-c5ed76cf1006 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:25.785254 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b5760-98e4-469f-886d-c5ed76cf1006 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:25.785543 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b5760-98e4-469f-886d-c5ed76cf1006 None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:25.786215 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b5760-98e4-469f-886d-c5ed76cf1006 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:15:25.786522 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b5760-98e4-469f-886d-c5ed76cf1006 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:25.787932 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b5760-98e4-469f-886d-c5ed76cf1006 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:25.792852 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 459/920] 10.222.0.65 () {56 vars in 1116 bytes} [Wed Jul 27 16:15:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:15:25.799148 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786436b-bbd4-4d29-8256-1a0aa3aa2848 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:25.827265 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:25.897199 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786436b-bbd4-4d29-8256-1a0aa3aa2848 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:25.930098 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7e637-4e27-42bf-a732-cc83981f2697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:25.930714 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7e637-4e27-42bf-a732-cc83981f2697 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:25.930996 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7e637-4e27-42bf-a732-cc83981f2697 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:25.931270 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7e637-4e27-42bf-a732-cc83981f2697 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:25.932050 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7e637-4e27-42bf-a732-cc83981f2697 None admin] RBAC: Adding query filter params (interface=public, service_id=0dc639edb6674fe482a52bd23ddd948e, region_id=RegionOne) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:15:25.932361 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7e637-4e27-42bf-a732-cc83981f2697 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:25.933732 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7e637-4e27-42bf-a732-cc83981f2697 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:25.939353 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 462/921] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Jul 27 16:15:25 2022] GET /identity/v3/endpoints?service_id=0dc639edb6674fe482a52bd23ddd948e&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:15:25.945075 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b5760-98e4-469f-886d-c5ed76cf1006 None admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:26.023939 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:26.042446 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b5760-98e4-469f-886d-c5ed76cf1006 None admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:26.076701 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef943a7f-15bb-4193-b0b6-0772a673d322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:26.077344 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef943a7f-15bb-4193-b0b6-0772a673d322 None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:26.077628 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef943a7f-15bb-4193-b0b6-0772a673d322 None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:26.077904 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef943a7f-15bb-4193-b0b6-0772a673d322 None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:26.078609 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef943a7f-15bb-4193-b0b6-0772a673d322 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:26.080052 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef943a7f-15bb-4193-b0b6-0772a673d322 None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:26.086361 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 460/922] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Jul 27 16:15:25 2022] GET /identity/v3/services => generated 1962 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:15:28.308272 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bd96d-5483-4337-91fa-9fa770bd293a None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:28.308814 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bd96d-5483-4337-91fa-9fa770bd293a None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:28.308814 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bd96d-5483-4337-91fa-9fa770bd293a None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:28.310202 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 463/923] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:15:28.316328 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f40cb7-79db-4335-8844-1e32fa7f0918 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:28.316740 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f40cb7-79db-4335-8844-1e32fa7f0918 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:28.316884 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f40cb7-79db-4335-8844-1e32fa7f0918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:28.334598 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-42f40cb7-79db-4335-8844-1e32fa7f0918 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:15:28.335828 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-42f40cb7-79db-4335-8844-1e32fa7f0918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:15:28.400456 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 461/924] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:15:28 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:15:28.423976 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bd96d-5483-4337-91fa-9fa770bd293a None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:28.514469 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:28.524282 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bd96d-5483-4337-91fa-9fa770bd293a None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:28.557842 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341e2e2-94dd-4c30-b324-06231a64035f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:28.558527 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341e2e2-94dd-4c30-b324-06231a64035f None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:28.558760 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341e2e2-94dd-4c30-b324-06231a64035f None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:28.559036 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341e2e2-94dd-4c30-b324-06231a64035f None admin] PATH_INFO: `/v3/services/placement` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:28.559697 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341e2e2-94dd-4c30-b324-06231a64035f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:28.561064 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341e2e2-94dd-4c30-b324-06231a64035f None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:28.569785 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-3341e2e2-94dd-4c30-b324-06231a64035f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 16:15:28.569785 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:15:28.569785 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:15:28.569785 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:15:28.569785 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:15:28.569785 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:15:28.569785 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:15:28.569785 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:15:28.569785 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 16:15:28.569785 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:15:28.569785 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:15:28.569785 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:15:28.569785 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:15:28.569785 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:15:28.569785 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:15:28.569785 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:15:28.569785 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:15:28.570955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:15:28.570955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:15:28.570955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:15:28.570955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:15:28.570955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:15:28.570955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:15:28.570955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:15:28.570955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:15:28.570955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:15:28.570955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:15:28.570955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:15:28.570955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:15:28.570955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:15:28.570955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:15:28.570955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:15:28.570955 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:15:28.571830 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:15:28.571830 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( Jul 27 16:15:28.571830 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:15:28.571830 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:15:28.571830 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:15:28.571830 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:15:28.571830 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:15:28.571830 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:15:28.571830 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:15:28.571830 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:15:28.571830 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:15:28.571830 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:15:28.571830 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 16:15:28.571830 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Jul 27 16:15:28.571830 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 464/925] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Jul 27 16:15:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:15:28.577114 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f40cb7-79db-4335-8844-1e32fa7f0918 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:28.651652 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:28.677646 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f40cb7-79db-4335-8844-1e32fa7f0918 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:28.710042 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf41f95-5ae2-499b-a9cc-ca91ae947e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:28.710642 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf41f95-5ae2-499b-a9cc-ca91ae947e9b None admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:28.710925 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf41f95-5ae2-499b-a9cc-ca91ae947e9b None admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:28.711200 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf41f95-5ae2-499b-a9cc-ca91ae947e9b None admin] PATH_INFO: `/v3/services` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:28.711901 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf41f95-5ae2-499b-a9cc-ca91ae947e9b None admin] RBAC: Adding query filter params (name=placement) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:15:28.712205 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf41f95-5ae2-499b-a9cc-ca91ae947e9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:28.713557 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf41f95-5ae2-499b-a9cc-ca91ae947e9b None admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:28.718411 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 462/926] 10.222.0.65 () {56 vars in 1116 bytes} [Wed Jul 27 16:15:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:15:28.724808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341e2e2-94dd-4c30-b324-06231a64035f None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:15:28.825215 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341e2e2-94dd-4c30-b324-06231a64035f None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:15:28.857715 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b972b7-0ef0-4e72-a68a-9111c9825265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:15:28.858318 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b972b7-0ef0-4e72-a68a-9111c9825265 None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:15:28.858598 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b972b7-0ef0-4e72-a68a-9111c9825265 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:15:28.858869 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b972b7-0ef0-4e72-a68a-9111c9825265 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:15:28.859601 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b972b7-0ef0-4e72-a68a-9111c9825265 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:15:28.861745 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b972b7-0ef0-4e72-a68a-9111c9825265 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:15:28.881136 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 465/927] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 16:15:28 2022] POST /identity/v3/endpoints => generated 331 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:15:38.715623 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=30 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:15:38.877252 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:16:27.970449 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885cdfb-dee9-4359-882f-9c868cc7f2cd None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:27.971023 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885cdfb-dee9-4359-882f-9c868cc7f2cd None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:27.971023 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885cdfb-dee9-4359-882f-9c868cc7f2cd None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:27.977486 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 463/928] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:16:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:16:27.979168 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c746ef-2c5d-4c95-94bf-e8e8a9c0776e None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:27.979717 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c746ef-2c5d-4c95-94bf-e8e8a9c0776e None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:27.979815 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c746ef-2c5d-4c95-94bf-e8e8a9c0776e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:28.004997 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-a0c746ef-2c5d-4c95-94bf-e8e8a9c0776e None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:16:28.006623 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-a0c746ef-2c5d-4c95-94bf-e8e8a9c0776e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:16:28.111491 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 466/929] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:16:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:16:28.162513 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47669816-b623-42fe-9f04-352ebd62114e None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:28.162738 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47669816-b623-42fe-9f04-352ebd62114e None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:28.163034 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47669816-b623-42fe-9f04-352ebd62114e None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:28.164611 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 464/930] 10.222.0.65 () {54 vars in 965 bytes} [Wed Jul 27 16:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:16:28.181016 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa6c52-b5f0-4771-82a6-29759b84bd5c None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:28.181310 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa6c52-b5f0-4771-82a6-29759b84bd5c None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:28.181593 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa6c52-b5f0-4771-82a6-29759b84bd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:28.238926 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-dcfa6c52-b5f0-4771-82a6-29759b84bd5c None None] MFA Rules not processed for user `6a95bd511e264733bf7ea71b28ad96ab`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:16:28.240175 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-dcfa6c52-b5f0-4771-82a6-29759b84bd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:16:28.337706 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 467/931] 10.222.0.65 () {58 vars in 1062 bytes} [Wed Jul 27 16:16:28 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:16:28.347649 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47669816-b623-42fe-9f04-352ebd62114e None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:16:28.360300 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47669816-b623-42fe-9f04-352ebd62114e None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:16:28.363794 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a3d46-2803-4c1b-9122-a438b66371a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:16:28.364392 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a3d46-2803-4c1b-9122-a438b66371a4 service neutron] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:28.364739 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a3d46-2803-4c1b-9122-a438b66371a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:28.364925 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a3d46-2803-4c1b-9122-a438b66371a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:28.375094 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a3d46-2803-4c1b-9122-a438b66371a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:16:28.377050 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a3d46-2803-4c1b-9122-a438b66371a4 service neutron] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:16:28.392749 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 465/932] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:16:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:16:30.926008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b32e9-a227-4703-b370-26b1b6e82ee4 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:30.926596 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b32e9-a227-4703-b370-26b1b6e82ee4 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:30.926596 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b32e9-a227-4703-b370-26b1b6e82ee4 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:30.928096 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 468/933] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:16:30.933076 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b172ac-5033-49e6-9395-07dc77db3c57 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:30.933510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b172ac-5033-49e6-9395-07dc77db3c57 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:30.933741 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b172ac-5033-49e6-9395-07dc77db3c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:30.953515 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-c1b172ac-5033-49e6-9395-07dc77db3c57 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:16:30.954714 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-c1b172ac-5033-49e6-9395-07dc77db3c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:16:30.962622 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 466/934] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:16:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:16:31.001453 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b32e9-a227-4703-b370-26b1b6e82ee4 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:16:31.012866 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b32e9-a227-4703-b370-26b1b6e82ee4 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:16:31.016894 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab7cef-1cfb-4815-aa4e-ec254217273c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:16:31.017514 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab7cef-1cfb-4815-aa4e-ec254217273c service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:31.017798 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab7cef-1cfb-4815-aa4e-ec254217273c service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:31.018083 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab7cef-1cfb-4815-aa4e-ec254217273c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:31.028217 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab7cef-1cfb-4815-aa4e-ec254217273c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:16:31.029636 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab7cef-1cfb-4815-aa4e-ec254217273c service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:16:31.039929 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 469/935] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:16:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:16:33.668044 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98e8b1-d375-40fc-98ba-8ec62f3a6863 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:33.668044 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98e8b1-d375-40fc-98ba-8ec62f3a6863 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:33.668044 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98e8b1-d375-40fc-98ba-8ec62f3a6863 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:33.669237 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 467/936] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:16:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:16:33.673964 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89026984-0118-4b54-86c6-95680e4b4c3a None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:33.673964 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89026984-0118-4b54-86c6-95680e4b4c3a None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:33.674416 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89026984-0118-4b54-86c6-95680e4b4c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:33.719346 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-89026984-0118-4b54-86c6-95680e4b4c3a None None] MFA Rules not processed for user `b4367dec09b843eeafd691b9d6214a78`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:16:33.720581 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-89026984-0118-4b54-86c6-95680e4b4c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:16:33.767275 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:16:33.797512 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 470/937] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:16:33 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:16:33.837441 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98e8b1-d375-40fc-98ba-8ec62f3a6863 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:16:33.848534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98e8b1-d375-40fc-98ba-8ec62f3a6863 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:16:33.852063 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6913c-5d7f-4b8b-b1a5-1cb490621862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:16:33.852672 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6913c-5d7f-4b8b-b1a5-1cb490621862 service neutron] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:33.852970 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6913c-5d7f-4b8b-b1a5-1cb490621862 service neutron] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:33.853231 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6913c-5d7f-4b8b-b1a5-1cb490621862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:33.878016 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6913c-5d7f-4b8b-b1a5-1cb490621862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:16:33.880630 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6913c-5d7f-4b8b-b1a5-1cb490621862 service neutron] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:16:33.895404 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 468/938] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:16:33 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:16:36.682953 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b53263-f31e-4296-9e2e-e808c599ab5a None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:36.683440 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b53263-f31e-4296-9e2e-e808c599ab5a None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:36.683669 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b53263-f31e-4296-9e2e-e808c599ab5a None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:36.685077 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 471/939] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:16:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:16:36.690108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab8c3e-c78a-41c5-b290-9329d5a7ba8a None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:36.690518 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab8c3e-c78a-41c5-b290-9329d5a7ba8a None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:36.690662 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab8c3e-c78a-41c5-b290-9329d5a7ba8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:36.710196 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-19ab8c3e-c78a-41c5-b290-9329d5a7ba8a None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:16:36.711432 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-19ab8c3e-c78a-41c5-b290-9329d5a7ba8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:16:36.782222 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 469/940] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:16:36 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:16:36.822318 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b53263-f31e-4296-9e2e-e808c599ab5a None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:16:36.849361 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b53263-f31e-4296-9e2e-e808c599ab5a None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:16:36.858188 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275d4dd-60cb-4008-a738-c479312331c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:16:36.858826 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275d4dd-60cb-4008-a738-c479312331c2 service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:36.859107 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275d4dd-60cb-4008-a738-c479312331c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:36.859410 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275d4dd-60cb-4008-a738-c479312331c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:36.875505 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6275d4dd-60cb-4008-a738-c479312331c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:16:36.876958 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6275d4dd-60cb-4008-a738-c479312331c2 service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:16:36.891052 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 472/941] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:16:36 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:16:39.781967 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6f6f1-b34a-4c2d-aa41-a2f1ed068aa2 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:39.782517 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6f6f1-b34a-4c2d-aa41-a2f1ed068aa2 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:39.782517 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6f6f1-b34a-4c2d-aa41-a2f1ed068aa2 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:39.783795 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 470/942] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:16:39.789020 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4e540-7987-485c-8bdd-0f12a654becf None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:39.789430 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4e540-7987-485c-8bdd-0f12a654becf None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:39.789574 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4e540-7987-485c-8bdd-0f12a654becf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:39.809155 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-14a4e540-7987-485c-8bdd-0f12a654becf None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:16:39.810322 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-14a4e540-7987-485c-8bdd-0f12a654becf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:16:39.817904 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 473/943] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:16:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:16:39.855902 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6f6f1-b34a-4c2d-aa41-a2f1ed068aa2 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:16:39.866586 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6f6f1-b34a-4c2d-aa41-a2f1ed068aa2 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:16:39.870345 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d888c8-01ef-46f4-be68-6f8f4afcfd76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:16:39.870950 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d888c8-01ef-46f4-be68-6f8f4afcfd76 service neutron] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:39.871235 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d888c8-01ef-46f4-be68-6f8f4afcfd76 service neutron] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:39.871547 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d888c8-01ef-46f4-be68-6f8f4afcfd76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:39.880906 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d888c8-01ef-46f4-be68-6f8f4afcfd76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:16:39.882337 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d888c8-01ef-46f4-be68-6f8f4afcfd76 service neutron] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:16:39.892591 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 471/944] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:16:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:16:42.205423 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d868fac-a0d9-4bb1-9d80-9012d931dbf1 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:42.205941 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d868fac-a0d9-4bb1-9d80-9012d931dbf1 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:42.205941 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d868fac-a0d9-4bb1-9d80-9012d931dbf1 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:42.207387 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 474/945] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:16:42.212700 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ac5b3-e493-415f-9868-e1871f1cc5c6 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:42.213137 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ac5b3-e493-415f-9868-e1871f1cc5c6 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:42.213325 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ac5b3-e493-415f-9868-e1871f1cc5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:42.232669 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-c48ac5b3-e493-415f-9868-e1871f1cc5c6 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:16:42.233863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-c48ac5b3-e493-415f-9868-e1871f1cc5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:16:42.241541 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 472/946] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:16:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:16:42.278002 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d868fac-a0d9-4bb1-9d80-9012d931dbf1 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:16:42.289420 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d868fac-a0d9-4bb1-9d80-9012d931dbf1 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:16:42.293747 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d60027-2aac-4424-b386-6ede28f971c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:16:42.294358 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d60027-2aac-4424-b386-6ede28f971c8 service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:42.294640 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d60027-2aac-4424-b386-6ede28f971c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:42.294916 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d60027-2aac-4424-b386-6ede28f971c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:42.303704 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d60027-2aac-4424-b386-6ede28f971c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:16:42.305138 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d60027-2aac-4424-b386-6ede28f971c8 service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:16:42.314997 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 475/947] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:16:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:16:44.597417 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453c3cf-63ee-4986-b255-97bd82ef2055 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:44.598000 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453c3cf-63ee-4986-b255-97bd82ef2055 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:44.598000 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453c3cf-63ee-4986-b255-97bd82ef2055 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:44.599405 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 473/948] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:16:44.605656 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c7317-c4d6-4fce-8fe7-d8f99c67e8b2 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:44.606180 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c7317-c4d6-4fce-8fe7-d8f99c67e8b2 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:44.606281 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c7317-c4d6-4fce-8fe7-d8f99c67e8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:44.627468 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-230c7317-c4d6-4fce-8fe7-d8f99c67e8b2 None None] MFA Rules not processed for user `b4367dec09b843eeafd691b9d6214a78`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:16:44.628685 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-230c7317-c4d6-4fce-8fe7-d8f99c67e8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:16:44.636813 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 476/949] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:16:44 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:16:44.676080 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453c3cf-63ee-4986-b255-97bd82ef2055 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:16:44.687307 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453c3cf-63ee-4986-b255-97bd82ef2055 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:16:44.690798 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadab267-6984-4cd2-8817-f758893d4a75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:16:44.691444 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadab267-6984-4cd2-8817-f758893d4a75 service neutron] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:44.691734 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadab267-6984-4cd2-8817-f758893d4a75 service neutron] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:44.692009 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadab267-6984-4cd2-8817-f758893d4a75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:44.701549 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadab267-6984-4cd2-8817-f758893d4a75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:16:44.702974 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadab267-6984-4cd2-8817-f758893d4a75 service neutron] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:16:44.712366 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 474/950] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:16:44 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:16:47.194680 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9e729-2169-4a25-9036-db6206afbf3c None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:47.195246 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9e729-2169-4a25-9036-db6206afbf3c None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:47.195246 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9e729-2169-4a25-9036-db6206afbf3c None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:47.196708 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 477/951] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:16:47.204598 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840d345-f1f0-4f9d-b647-21c0d786ccaa None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:47.205157 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840d345-f1f0-4f9d-b647-21c0d786ccaa None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:47.205383 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840d345-f1f0-4f9d-b647-21c0d786ccaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:47.226396 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-9840d345-f1f0-4f9d-b647-21c0d786ccaa None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:16:47.227774 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-9840d345-f1f0-4f9d-b647-21c0d786ccaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:16:47.235968 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 475/952] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:16:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:16:47.274464 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9e729-2169-4a25-9036-db6206afbf3c None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:16:47.285814 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9e729-2169-4a25-9036-db6206afbf3c None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:16:47.289294 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb09ae-2628-491a-b5e5-de10bc6ef872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:16:47.289925 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb09ae-2628-491a-b5e5-de10bc6ef872 service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:47.290205 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb09ae-2628-491a-b5e5-de10bc6ef872 service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:47.291473 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb09ae-2628-491a-b5e5-de10bc6ef872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:47.301865 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb09ae-2628-491a-b5e5-de10bc6ef872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:16:47.303311 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb09ae-2628-491a-b5e5-de10bc6ef872 service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:16:47.314405 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 478/953] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:16:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:16:49.633735 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422854a4-a280-411a-8462-52535589fbfa None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:49.634284 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422854a4-a280-411a-8462-52535589fbfa None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:49.634398 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422854a4-a280-411a-8462-52535589fbfa None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:49.635917 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 476/954] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:16:49.641127 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6938fe-e290-4844-88ba-b2b0975e0107 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:49.641581 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6938fe-e290-4844-88ba-b2b0975e0107 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:49.641765 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6938fe-e290-4844-88ba-b2b0975e0107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:49.660745 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-1e6938fe-e290-4844-88ba-b2b0975e0107 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:16:49.661970 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-1e6938fe-e290-4844-88ba-b2b0975e0107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:16:49.679784 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 479/955] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:16:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:16:49.711780 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422854a4-a280-411a-8462-52535589fbfa None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:16:49.717146 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=65 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:16:49.724359 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422854a4-a280-411a-8462-52535589fbfa None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:16:49.728913 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9b427-6c51-4754-b707-0f7300a9a343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:16:49.729718 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9b427-6c51-4754-b707-0f7300a9a343 service neutron] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:49.730152 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9b427-6c51-4754-b707-0f7300a9a343 service neutron] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:49.730576 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9b427-6c51-4754-b707-0f7300a9a343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:49.740209 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a9b427-6c51-4754-b707-0f7300a9a343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:16:49.741833 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a9b427-6c51-4754-b707-0f7300a9a343 service neutron] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:16:49.752345 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 477/956] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:16:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:16:52.330831 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528535d-b529-4f81-80c4-17ef8a281f45 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:52.331416 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528535d-b529-4f81-80c4-17ef8a281f45 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:52.331416 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528535d-b529-4f81-80c4-17ef8a281f45 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:52.332773 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 480/957] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:16:52.338665 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c14bc8-afca-4010-b463-38f311d93e45 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:52.339082 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c14bc8-afca-4010-b463-38f311d93e45 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:52.339225 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c14bc8-afca-4010-b463-38f311d93e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:52.359561 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-a6c14bc8-afca-4010-b463-38f311d93e45 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:16:52.360757 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-a6c14bc8-afca-4010-b463-38f311d93e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:16:52.368594 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 478/958] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:16:52 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:16:52.405186 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e528535d-b529-4f81-80c4-17ef8a281f45 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:16:52.418911 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e528535d-b529-4f81-80c4-17ef8a281f45 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:16:52.422425 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e3dca-dc8c-4a21-8d27-c48e9024cde7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:16:52.423041 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e3dca-dc8c-4a21-8d27-c48e9024cde7 service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:52.423327 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e3dca-dc8c-4a21-8d27-c48e9024cde7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:52.423642 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e3dca-dc8c-4a21-8d27-c48e9024cde7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:52.432629 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e3dca-dc8c-4a21-8d27-c48e9024cde7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:16:52.434047 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e3dca-dc8c-4a21-8d27-c48e9024cde7 service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:16:52.443604 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 481/959] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:16:52 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:16:56.631606 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bee8d9-4a1c-4a9f-8adc-910949853829 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:56.632236 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bee8d9-4a1c-4a9f-8adc-910949853829 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:56.632236 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bee8d9-4a1c-4a9f-8adc-910949853829 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:56.634151 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 479/960] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:16:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:16:56.639427 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d86c6-70cf-4d9b-9f38-1d88a9363299 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:56.639824 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d86c6-70cf-4d9b-9f38-1d88a9363299 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:56.639981 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d86c6-70cf-4d9b-9f38-1d88a9363299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:56.659603 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-b13d86c6-70cf-4d9b-9f38-1d88a9363299 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:16:56.660778 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-b13d86c6-70cf-4d9b-9f38-1d88a9363299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:16:56.669321 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 482/961] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:16:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:16:56.722431 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a53530-590c-4c37-954d-de40549c7dd8 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:56.722855 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a53530-590c-4c37-954d-de40549c7dd8 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:56.723228 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a53530-590c-4c37-954d-de40549c7dd8 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:56.724666 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 480/962] 10.222.0.65 () {54 vars in 965 bytes} [Wed Jul 27 16:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:16:56.730588 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b82bd-15f4-4695-9656-03d3c2e0f13b None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:56.730937 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b82bd-15f4-4695-9656-03d3c2e0f13b None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:56.731276 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b82bd-15f4-4695-9656-03d3c2e0f13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:56.750901 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-499b82bd-15f4-4695-9656-03d3c2e0f13b None None] MFA Rules not processed for user `6a95bd511e264733bf7ea71b28ad96ab`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:16:56.752116 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-499b82bd-15f4-4695-9656-03d3c2e0f13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:16:56.759004 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 483/963] 10.222.0.65 () {58 vars in 1062 bytes} [Wed Jul 27 16:16:56 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:16:56.767752 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a53530-590c-4c37-954d-de40549c7dd8 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:16:56.778518 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a53530-590c-4c37-954d-de40549c7dd8 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:16:56.782065 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746a11a-ddf6-41f3-baad-c2367117927f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:16:56.782740 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746a11a-ddf6-41f3-baad-c2367117927f service neutron] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:16:56.783092 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746a11a-ddf6-41f3-baad-c2367117927f service neutron] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:16:56.783473 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746a11a-ddf6-41f3-baad-c2367117927f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:16:56.792593 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746a11a-ddf6-41f3-baad-c2367117927f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:16:56.794122 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746a11a-ddf6-41f3-baad-c2367117927f service neutron] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:16:56.803477 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 481/964] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:16:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:17:00.226107 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e73bdc-b2b5-41e6-8536-0d2c34ea6c19 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:00.227182 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e73bdc-b2b5-41e6-8536-0d2c34ea6c19 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:00.227274 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e73bdc-b2b5-41e6-8536-0d2c34ea6c19 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:00.228690 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 484/965] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:17:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:17:00.233951 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a415ec-2ecd-4b23-91b1-f34c06a1807a None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:00.234344 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a415ec-2ecd-4b23-91b1-f34c06a1807a None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:00.234516 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a415ec-2ecd-4b23-91b1-f34c06a1807a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:00.254157 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-73a415ec-2ecd-4b23-91b1-f34c06a1807a None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:17:00.255361 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-73a415ec-2ecd-4b23-91b1-f34c06a1807a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:17:00.263742 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 482/966] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:17:00 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:17:00.302642 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e73bdc-b2b5-41e6-8536-0d2c34ea6c19 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:17:00.314229 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e73bdc-b2b5-41e6-8536-0d2c34ea6c19 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:17:00.317869 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fc404-60eb-4072-ae24-79063891ad7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:17:00.318504 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fc404-60eb-4072-ae24-79063891ad7a service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:00.318765 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fc404-60eb-4072-ae24-79063891ad7a service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:00.319098 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fc404-60eb-4072-ae24-79063891ad7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:00.328544 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38fc404-60eb-4072-ae24-79063891ad7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:17:00.330169 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38fc404-60eb-4072-ae24-79063891ad7a service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:17:00.341437 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 485/967] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:17:00 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:17:04.939777 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036a066-c894-4fef-8b53-7dd723099763 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:04.940339 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036a066-c894-4fef-8b53-7dd723099763 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:04.940339 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036a066-c894-4fef-8b53-7dd723099763 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:04.941676 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 483/968] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:17:04.947438 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44df7c-1e56-4638-ac58-547f6e317802 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:04.947870 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44df7c-1e56-4638-ac58-547f6e317802 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:04.948006 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44df7c-1e56-4638-ac58-547f6e317802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:04.955606 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=57 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:17:04.969492 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-6e44df7c-1e56-4638-ac58-547f6e317802 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:17:04.971559 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-6e44df7c-1e56-4638-ac58-547f6e317802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:17:04.982791 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 486/969] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:17:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:17:05.023663 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036a066-c894-4fef-8b53-7dd723099763 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:17:05.037943 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036a066-c894-4fef-8b53-7dd723099763 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:17:05.043954 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbd790-aec2-45ab-b2b0-398e3044fe41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:17:05.044576 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbd790-aec2-45ab-b2b0-398e3044fe41 service neutron] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:05.044854 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbd790-aec2-45ab-b2b0-398e3044fe41 service neutron] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:05.045127 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbd790-aec2-45ab-b2b0-398e3044fe41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:05.055392 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbd790-aec2-45ab-b2b0-398e3044fe41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:17:05.056842 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbd790-aec2-45ab-b2b0-398e3044fe41 service neutron] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:17:05.066148 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 484/970] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:17:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:17:10.437656 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3355d18-7bb1-4cd1-9caf-26eebff8a533 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:10.438564 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3355d18-7bb1-4cd1-9caf-26eebff8a533 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:10.439016 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3355d18-7bb1-4cd1-9caf-26eebff8a533 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:10.440927 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 487/971] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 16:17:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:17:10.446271 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b99498-a554-4f3b-ad05-8805763ef6a0 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:10.447183 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b99498-a554-4f3b-ad05-8805763ef6a0 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:10.447670 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b99498-a554-4f3b-ad05-8805763ef6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:10.519663 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-e5b99498-a554-4f3b-ad05-8805763ef6a0 None None] MFA Rules not processed for user `c311ccdc0d434bb6a9ef99da9a5404bf`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:17:10.521284 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-e5b99498-a554-4f3b-ad05-8805763ef6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:17:10.619960 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 485/972] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 16:17:10 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:17:14.964107 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=2 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:17:15.043762 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797366c-6e2c-449f-957b-895a3ea32745 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:15.044303 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797366c-6e2c-449f-957b-895a3ea32745 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:15.044585 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797366c-6e2c-449f-957b-895a3ea32745 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:15.045947 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 488/973] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 16:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:17:15.051512 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3e481-d6e2-4a6a-a5ff-55983877b458 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:15.051990 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3e481-d6e2-4a6a-a5ff-55983877b458 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:15.052384 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3e481-d6e2-4a6a-a5ff-55983877b458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:15.073518 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-f7b3e481-d6e2-4a6a-a5ff-55983877b458 None None] MFA Rules not processed for user `c311ccdc0d434bb6a9ef99da9a5404bf`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:17:15.074838 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-f7b3e481-d6e2-4a6a-a5ff-55983877b458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:17:15.083824 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 486/974] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 16:17:15 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:17:16.696991 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066aa709-6e1b-4fc9-8e33-ee9cbb6e444d None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:16.697493 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066aa709-6e1b-4fc9-8e33-ee9cbb6e444d None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:16.697650 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066aa709-6e1b-4fc9-8e33-ee9cbb6e444d None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:16.699078 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 489/975] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 16:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:17:16.704252 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13823d0c-5ea2-4a54-b22e-6f257ff3b1b6 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:16.704683 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13823d0c-5ea2-4a54-b22e-6f257ff3b1b6 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:16.704910 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13823d0c-5ea2-4a54-b22e-6f257ff3b1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:16.726492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-13823d0c-5ea2-4a54-b22e-6f257ff3b1b6 None None] MFA Rules not processed for user `c311ccdc0d434bb6a9ef99da9a5404bf`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:17:16.727806 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-13823d0c-5ea2-4a54-b22e-6f257ff3b1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:17:16.736339 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 487/976] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 16:17:16 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:17:20.643884 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c8201-606d-4020-b80b-6ec5eadb7955 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:20.644418 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c8201-606d-4020-b80b-6ec5eadb7955 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:20.644418 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c8201-606d-4020-b80b-6ec5eadb7955 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:20.650041 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 490/977] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:17:20.651810 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58417d-1524-41e7-abe3-6217e9700e6e None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:20.652478 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58417d-1524-41e7-abe3-6217e9700e6e None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:20.652478 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58417d-1524-41e7-abe3-6217e9700e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:20.662955 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=69 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:17:20.686959 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-1c58417d-1524-41e7-abe3-6217e9700e6e None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:17:20.688538 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-1c58417d-1524-41e7-abe3-6217e9700e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:17:20.707396 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 488/978] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:17:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:17:20.756980 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d4972-d655-46c9-bf29-a1eef063d29b None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:20.757362 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d4972-d655-46c9-bf29-a1eef063d29b None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:20.757721 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d4972-d655-46c9-bf29-a1eef063d29b None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:20.759166 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 491/979] 10.222.0.65 () {54 vars in 962 bytes} [Wed Jul 27 16:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:17:20.766457 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233a2db-9981-432f-ba57-6efcf4da1673 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:20.766750 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233a2db-9981-432f-ba57-6efcf4da1673 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:20.767183 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233a2db-9981-432f-ba57-6efcf4da1673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:20.810699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-3233a2db-9981-432f-ba57-6efcf4da1673 None None] MFA Rules not processed for user `66768f9443c046b3bd75853a4b2b980e`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:17:20.811912 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-3233a2db-9981-432f-ba57-6efcf4da1673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:17:20.891902 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 489/980] 10.222.0.65 () {58 vars in 1059 bytes} [Wed Jul 27 16:17:20 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:17:20.900192 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d4972-d655-46c9-bf29-a1eef063d29b None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:17:20.914929 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d4972-d655-46c9-bf29-a1eef063d29b None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:17:20.920183 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c4faf-b154-4181-8728-3ca1f80af361 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:17:20.920804 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c4faf-b154-4181-8728-3ca1f80af361 service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:20.921162 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c4faf-b154-4181-8728-3ca1f80af361 service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:20.921609 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c4faf-b154-4181-8728-3ca1f80af361 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:20.930481 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c4faf-b154-4181-8728-3ca1f80af361 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:17:20.932308 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c4faf-b154-4181-8728-3ca1f80af361 service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:17:20.942523 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 492/981] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:17:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:17:23.409439 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fe5fb-290e-4151-a118-8e03cd062c64 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:23.409978 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fe5fb-290e-4151-a118-8e03cd062c64 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:23.409978 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fe5fb-290e-4151-a118-8e03cd062c64 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:23.411593 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 490/982] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:17:23.417043 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897ad25-ca0e-4350-a471-e854e9070c5e None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:23.417515 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897ad25-ca0e-4350-a471-e854e9070c5e None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:23.417612 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897ad25-ca0e-4350-a471-e854e9070c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:23.437076 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-6897ad25-ca0e-4350-a471-e854e9070c5e None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:17:23.438264 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-6897ad25-ca0e-4350-a471-e854e9070c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:17:23.446803 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 493/983] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:17:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:17:23.492097 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fe5fb-290e-4151-a118-8e03cd062c64 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:17:23.507148 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fe5fb-290e-4151-a118-8e03cd062c64 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:17:23.514497 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ce134-fe17-4aff-9199-82f42c4b155d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:17:23.515577 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ce134-fe17-4aff-9199-82f42c4b155d service nova] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:23.515932 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ce134-fe17-4aff-9199-82f42c4b155d service nova] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:23.516282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ce134-fe17-4aff-9199-82f42c4b155d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:23.529071 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ce134-fe17-4aff-9199-82f42c4b155d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:17:23.531086 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ce134-fe17-4aff-9199-82f42c4b155d service nova] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:17:23.543673 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 491/984] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:17:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:17:26.128698 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bd23c-9af2-4fa9-97a4-a1128fd0dea1 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:26.129688 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bd23c-9af2-4fa9-97a4-a1128fd0dea1 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:26.130666 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bd23c-9af2-4fa9-97a4-a1128fd0dea1 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:26.132297 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 494/985] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:17:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:17:26.137831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917d4e6-98ea-4efd-8e6d-b40da92be36d None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:26.138279 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917d4e6-98ea-4efd-8e6d-b40da92be36d None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:26.138523 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917d4e6-98ea-4efd-8e6d-b40da92be36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:26.157824 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-3917d4e6-98ea-4efd-8e6d-b40da92be36d None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:17:26.159012 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-3917d4e6-98ea-4efd-8e6d-b40da92be36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:17:26.167093 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 492/986] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:17:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:17:26.213686 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2898115-2288-4a9d-a12d-cbcf0b1aa046 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:26.213972 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2898115-2288-4a9d-a12d-cbcf0b1aa046 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:26.214447 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2898115-2288-4a9d-a12d-cbcf0b1aa046 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:26.220485 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 495/987] 10.222.0.65 () {54 vars in 962 bytes} [Wed Jul 27 16:17:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:17:26.221647 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15453944-ced8-4eaa-a159-03a3d03010b6 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:26.221943 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15453944-ced8-4eaa-a159-03a3d03010b6 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:26.222222 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15453944-ced8-4eaa-a159-03a3d03010b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:26.244291 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-15453944-ced8-4eaa-a159-03a3d03010b6 None None] MFA Rules not processed for user `66768f9443c046b3bd75853a4b2b980e`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:17:26.245726 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-15453944-ced8-4eaa-a159-03a3d03010b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:17:26.254170 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 493/988] 10.222.0.65 () {58 vars in 1059 bytes} [Wed Jul 27 16:17:26 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:17:26.263023 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2898115-2288-4a9d-a12d-cbcf0b1aa046 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:17:26.276876 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2898115-2288-4a9d-a12d-cbcf0b1aa046 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:17:26.282124 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815b747-2a6c-45ee-a417-647297b508b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:17:26.283142 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815b747-2a6c-45ee-a417-647297b508b1 service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:26.283730 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815b747-2a6c-45ee-a417-647297b508b1 service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:26.284204 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815b747-2a6c-45ee-a417-647297b508b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:26.295723 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3815b747-2a6c-45ee-a417-647297b508b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:17:26.298181 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3815b747-2a6c-45ee-a417-647297b508b1 service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:17:26.315261 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 496/989] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:17:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:17:28.700667 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475271b-e0ac-4a1b-808f-d97481bb620e None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:28.701590 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475271b-e0ac-4a1b-808f-d97481bb620e None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:28.702053 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475271b-e0ac-4a1b-808f-d97481bb620e None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:28.703920 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 494/990] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:17:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:17:28.709633 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168af27-47f8-4bd9-8c57-0c33427493b4 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:28.710588 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168af27-47f8-4bd9-8c57-0c33427493b4 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:28.711057 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168af27-47f8-4bd9-8c57-0c33427493b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:28.733437 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-1168af27-47f8-4bd9-8c57-0c33427493b4 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:17:28.734938 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-1168af27-47f8-4bd9-8c57-0c33427493b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:17:28.751728 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 497/991] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:17:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:17:28.791561 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475271b-e0ac-4a1b-808f-d97481bb620e None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:17:28.808414 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475271b-e0ac-4a1b-808f-d97481bb620e None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:17:28.813907 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75eb009-e5bb-43ff-a3dd-fccf089e42a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:17:28.814767 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75eb009-e5bb-43ff-a3dd-fccf089e42a3 service nova] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:28.815267 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75eb009-e5bb-43ff-a3dd-fccf089e42a3 service nova] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:28.815852 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75eb009-e5bb-43ff-a3dd-fccf089e42a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:28.826927 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75eb009-e5bb-43ff-a3dd-fccf089e42a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:17:28.828863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75eb009-e5bb-43ff-a3dd-fccf089e42a3 service nova] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:17:28.851498 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 495/992] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:17:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:17:30.729339 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99d284-43c5-496c-9c3a-cc1bcdcf6427 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:30.729829 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99d284-43c5-496c-9c3a-cc1bcdcf6427 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:30.729927 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99d284-43c5-496c-9c3a-cc1bcdcf6427 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:30.731564 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 498/993] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:17:30.736801 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438f814-75db-4c53-a64d-e070c7a44f36 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:30.737242 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438f814-75db-4c53-a64d-e070c7a44f36 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:30.737490 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438f814-75db-4c53-a64d-e070c7a44f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:30.758301 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-0438f814-75db-4c53-a64d-e070c7a44f36 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:17:30.759539 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-0438f814-75db-4c53-a64d-e070c7a44f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:17:30.768286 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 496/994] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:17:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:17:31.115646 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec44d18-23d0-4d66-9e68-ecc39f9955f1 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:31.115945 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec44d18-23d0-4d66-9e68-ecc39f9955f1 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:31.116227 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec44d18-23d0-4d66-9e68-ecc39f9955f1 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:31.119419 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 499/995] 10.222.0.65 () {54 vars in 964 bytes} [Wed Jul 27 16:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:17:31.123170 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb9a69-41bb-4fec-b079-670b6a33e3ff None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:31.123691 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb9a69-41bb-4fec-b079-670b6a33e3ff None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:31.124167 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb9a69-41bb-4fec-b079-670b6a33e3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:31.165925 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-6abb9a69-41bb-4fec-b079-670b6a33e3ff None None] MFA Rules not processed for user `4b6d1f7acba3415f84c2f01b66190b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:17:31.167448 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-6abb9a69-41bb-4fec-b079-670b6a33e3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:17:31.228363 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c35a5-6f02-4721-9aa1-63a7478d9619 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:31.228745 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c35a5-6f02-4721-9aa1-63a7478d9619 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:31.229436 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c35a5-6f02-4721-9aa1-63a7478d9619 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:31.231252 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 500/996] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:17:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:17:31.236924 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df4400-cda1-4490-bc43-6d9389395662 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:31.237210 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df4400-cda1-4490-bc43-6d9389395662 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:31.237672 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df4400-cda1-4490-bc43-6d9389395662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:31.240903 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 497/997] 10.222.0.65 () {58 vars in 1061 bytes} [Wed Jul 27 16:17:31 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:17:31.249300 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb9a69-41bb-4fec-b079-670b6a33e3ff None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:17:31.258883 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb9a69-41bb-4fec-b079-670b6a33e3ff None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:17:31.259778 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-f0df4400-cda1-4490-bc43-6d9389395662 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:17:31.261031 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-f0df4400-cda1-4490-bc43-6d9389395662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:17:31.262981 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a90f0d-30cb-4369-9c86-c3eb68bba24e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6d1f7acba3415f84c2f01b66190b8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:17:31.263677 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a90f0d-30cb-4369-9c86-c3eb68bba24e service cinder] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:31.263954 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a90f0d-30cb-4369-9c86-c3eb68bba24e service cinder] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:31.264233 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a90f0d-30cb-4369-9c86-c3eb68bba24e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:31.269399 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 501/998] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:17:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:17:31.274586 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a90f0d-30cb-4369-9c86-c3eb68bba24e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:17:31.276085 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a90f0d-30cb-4369-9c86-c3eb68bba24e service cinder] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:17:31.280683 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:17:31.290206 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 498/999] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:17:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:17:31.315496 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df4400-cda1-4490-bc43-6d9389395662 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:17:31.327842 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df4400-cda1-4490-bc43-6d9389395662 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:17:31.334044 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe96326-af45-4c8d-a9e9-96e9b201f34e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:17:31.334804 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe96326-af45-4c8d-a9e9-96e9b201f34e service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:31.335222 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe96326-af45-4c8d-a9e9-96e9b201f34e service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:31.335668 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe96326-af45-4c8d-a9e9-96e9b201f34e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:31.345547 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe96326-af45-4c8d-a9e9-96e9b201f34e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:17:31.347163 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe96326-af45-4c8d-a9e9-96e9b201f34e service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:17:31.357232 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 502/1000] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:17:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:17:33.661355 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30261fc7-5bf3-4521-9a97-c863f76baf8e None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:33.661819 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30261fc7-5bf3-4521-9a97-c863f76baf8e None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:33.661913 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30261fc7-5bf3-4521-9a97-c863f76baf8e None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:33.664049 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 499/1001] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:17:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:17:33.669417 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd17039-bbde-4d1c-abcc-55fa1cc94b02 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:33.669912 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd17039-bbde-4d1c-abcc-55fa1cc94b02 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:33.670168 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd17039-bbde-4d1c-abcc-55fa1cc94b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:33.689654 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-cdd17039-bbde-4d1c-abcc-55fa1cc94b02 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:17:33.691550 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-cdd17039-bbde-4d1c-abcc-55fa1cc94b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:17:33.699526 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 503/1002] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:17:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:17:33.746491 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30261fc7-5bf3-4521-9a97-c863f76baf8e None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:17:33.760269 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30261fc7-5bf3-4521-9a97-c863f76baf8e None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:17:33.765395 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a5e4e-2756-4d70-97ca-a2d28219fa85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:17:33.766009 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a5e4e-2756-4d70-97ca-a2d28219fa85 service nova] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:33.766294 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a5e4e-2756-4d70-97ca-a2d28219fa85 service nova] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:33.766575 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a5e4e-2756-4d70-97ca-a2d28219fa85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:33.775973 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a5e4e-2756-4d70-97ca-a2d28219fa85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:17:33.777545 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a5e4e-2756-4d70-97ca-a2d28219fa85 service nova] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:17:33.788549 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 500/1003] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:17:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:17:36.158357 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2399918-2eb0-4359-9dec-90de585ac3d6 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:36.159263 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2399918-2eb0-4359-9dec-90de585ac3d6 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:36.159577 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2399918-2eb0-4359-9dec-90de585ac3d6 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:36.161514 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 504/1004] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:17:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:17:36.167017 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf82df-7d35-4057-b3fe-97459b5e2265 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:36.167516 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf82df-7d35-4057-b3fe-97459b5e2265 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:36.167607 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf82df-7d35-4057-b3fe-97459b5e2265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:36.187926 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-f0bf82df-7d35-4057-b3fe-97459b5e2265 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:17:36.189134 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-f0bf82df-7d35-4057-b3fe-97459b5e2265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:17:36.197147 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 501/1005] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:17:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:17:36.241408 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2399918-2eb0-4359-9dec-90de585ac3d6 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:17:36.256587 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2399918-2eb0-4359-9dec-90de585ac3d6 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:17:36.261970 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85595e22-6e89-4d44-8de5-fcba3fe09fd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:17:36.262598 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85595e22-6e89-4d44-8de5-fcba3fe09fd8 service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:36.262884 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85595e22-6e89-4d44-8de5-fcba3fe09fd8 service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:36.263165 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85595e22-6e89-4d44-8de5-fcba3fe09fd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:36.272405 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85595e22-6e89-4d44-8de5-fcba3fe09fd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:17:36.273668 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85595e22-6e89-4d44-8de5-fcba3fe09fd8 service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:17:36.283935 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 505/1006] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:17:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:17:38.564917 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6e162-97df-46da-b4f1-9ab1969668ed None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:38.565549 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6e162-97df-46da-b4f1-9ab1969668ed None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:38.565549 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6e162-97df-46da-b4f1-9ab1969668ed None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:38.566854 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 502/1007] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:17:38.572333 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371afb7e-a34c-4db8-af71-6c5b2f1421bf None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:38.572808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371afb7e-a34c-4db8-af71-6c5b2f1421bf None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:38.573278 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371afb7e-a34c-4db8-af71-6c5b2f1421bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:38.592574 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-371afb7e-a34c-4db8-af71-6c5b2f1421bf None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:17:38.593908 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-371afb7e-a34c-4db8-af71-6c5b2f1421bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:17:38.602759 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 506/1008] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:17:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:17:38.648335 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6e162-97df-46da-b4f1-9ab1969668ed None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:17:38.663618 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6e162-97df-46da-b4f1-9ab1969668ed None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:17:38.675861 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc25096-f055-4854-a45c-3c3161de7391 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:17:38.676730 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc25096-f055-4854-a45c-3c3161de7391 service nova] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:38.677230 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc25096-f055-4854-a45c-3c3161de7391 service nova] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:38.677591 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc25096-f055-4854-a45c-3c3161de7391 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:38.687195 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc25096-f055-4854-a45c-3c3161de7391 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:17:38.688885 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc25096-f055-4854-a45c-3c3161de7391 service nova] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:17:38.699577 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 503/1009] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:17:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:17:41.018278 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18971a52-ec37-4c26-af02-36f32175f30c None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:41.019786 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18971a52-ec37-4c26-af02-36f32175f30c None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:41.019786 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18971a52-ec37-4c26-af02-36f32175f30c None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:41.020691 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 507/1010] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:17:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:17:41.025879 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f712c2-06a4-47f3-98bb-fc1ea4ac2e99 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:41.026451 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f712c2-06a4-47f3-98bb-fc1ea4ac2e99 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:41.026451 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f712c2-06a4-47f3-98bb-fc1ea4ac2e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:41.053353 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-43f712c2-06a4-47f3-98bb-fc1ea4ac2e99 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:17:41.055138 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-43f712c2-06a4-47f3-98bb-fc1ea4ac2e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:17:41.074735 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 504/1011] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:17:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:17:41.135930 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18971a52-ec37-4c26-af02-36f32175f30c None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:17:41.149846 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18971a52-ec37-4c26-af02-36f32175f30c None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:17:41.154647 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e7132-042f-4f75-88b6-1f65836bc9da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:17:41.155263 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e7132-042f-4f75-88b6-1f65836bc9da service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:41.155575 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e7132-042f-4f75-88b6-1f65836bc9da service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:41.155856 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e7132-042f-4f75-88b6-1f65836bc9da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:41.165124 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e7132-042f-4f75-88b6-1f65836bc9da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:17:41.166810 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e7132-042f-4f75-88b6-1f65836bc9da service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:17:41.176335 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 508/1012] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:17:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:17:43.594536 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb49f20-7d33-4a97-9e5b-fd3250ead9b7 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:43.595164 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb49f20-7d33-4a97-9e5b-fd3250ead9b7 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:43.595268 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb49f20-7d33-4a97-9e5b-fd3250ead9b7 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:43.597639 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 505/1013] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:17:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:17:43.604376 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27abf9-4fff-4822-a459-104033bd1e69 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:43.605023 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27abf9-4fff-4822-a459-104033bd1e69 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:43.605023 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27abf9-4fff-4822-a459-104033bd1e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:43.629325 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-3a27abf9-4fff-4822-a459-104033bd1e69 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:17:43.630521 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-3a27abf9-4fff-4822-a459-104033bd1e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:17:43.638606 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 509/1014] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:17:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:17:43.697944 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb49f20-7d33-4a97-9e5b-fd3250ead9b7 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:17:43.715280 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb49f20-7d33-4a97-9e5b-fd3250ead9b7 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:17:43.722530 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84daa9-d7ce-4084-80f7-c902feeac5b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:17:43.723332 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84daa9-d7ce-4084-80f7-c902feeac5b5 service nova] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:43.723713 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84daa9-d7ce-4084-80f7-c902feeac5b5 service nova] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:43.724328 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84daa9-d7ce-4084-80f7-c902feeac5b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:43.735549 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef84daa9-d7ce-4084-80f7-c902feeac5b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:17:43.738383 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef84daa9-d7ce-4084-80f7-c902feeac5b5 service nova] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:17:43.751462 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 506/1015] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:17:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:17:46.719927 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38632a6a-dad6-4577-afb7-3ea553a5386d None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:46.720546 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38632a6a-dad6-4577-afb7-3ea553a5386d None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:46.720546 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38632a6a-dad6-4577-afb7-3ea553a5386d None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:46.721897 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 510/1016] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:17:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:17:46.727276 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e22dd9-5bd3-4a6c-82b8-945b822668c0 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:46.727863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e22dd9-5bd3-4a6c-82b8-945b822668c0 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:46.727863 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e22dd9-5bd3-4a6c-82b8-945b822668c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:46.746802 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-a0e22dd9-5bd3-4a6c-82b8-945b822668c0 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:17:46.748019 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-a0e22dd9-5bd3-4a6c-82b8-945b822668c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:17:46.756230 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 507/1017] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:17:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:17:46.804089 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38632a6a-dad6-4577-afb7-3ea553a5386d None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:17:46.811855 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=49 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:17:46.821539 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38632a6a-dad6-4577-afb7-3ea553a5386d None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:17:46.827150 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0281a3a-74a4-4934-bdbb-cfb59534a89b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:17:46.828064 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0281a3a-74a4-4934-bdbb-cfb59534a89b service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:46.828682 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0281a3a-74a4-4934-bdbb-cfb59534a89b service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:46.829191 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0281a3a-74a4-4934-bdbb-cfb59534a89b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:46.839472 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0281a3a-74a4-4934-bdbb-cfb59534a89b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:17:46.841279 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0281a3a-74a4-4934-bdbb-cfb59534a89b service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:17:46.851893 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 511/1018] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:17:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:17:47.146589 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093a2d0-56c6-4ad5-8ebf-cd24a26ec7d0 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:47.146998 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093a2d0-56c6-4ad5-8ebf-cd24a26ec7d0 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:47.147406 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093a2d0-56c6-4ad5-8ebf-cd24a26ec7d0 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:47.148838 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 508/1019] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:17:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:17:47.154237 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a12f5f-5057-4d14-982e-92b23ba416e3 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:47.154541 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a12f5f-5057-4d14-982e-92b23ba416e3 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:47.154864 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a12f5f-5057-4d14-982e-92b23ba416e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:47.174855 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-44a12f5f-5057-4d14-982e-92b23ba416e3 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:17:47.176103 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-44a12f5f-5057-4d14-982e-92b23ba416e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:17:47.183963 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 512/1020] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:17:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:17:47.241005 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108c5cb-e727-469f-9a83-10b5ff4ec613 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:47.241428 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108c5cb-e727-469f-9a83-10b5ff4ec613 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:47.241845 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108c5cb-e727-469f-9a83-10b5ff4ec613 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:47.243615 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 509/1021] 10.222.0.65 () {54 vars in 966 bytes} [Wed Jul 27 16:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:17:47.249211 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d924b2c-3f27-4873-a9f1-97cb35f592cf None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:47.249537 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d924b2c-3f27-4873-a9f1-97cb35f592cf None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:47.249817 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d924b2c-3f27-4873-a9f1-97cb35f592cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:47.290223 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-8d924b2c-3f27-4873-a9f1-97cb35f592cf None None] MFA Rules not processed for user `43377fb5ab3c4ddfb54b3b2cae8eb351`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:17:47.291446 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-8d924b2c-3f27-4873-a9f1-97cb35f592cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:17:47.351569 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 513/1022] 10.222.0.65 () {58 vars in 1063 bytes} [Wed Jul 27 16:17:47 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:17:47.358890 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108c5cb-e727-469f-9a83-10b5ff4ec613 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:17:47.369968 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108c5cb-e727-469f-9a83-10b5ff4ec613 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:17:47.373477 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388f871-4fb8-4a5d-8988-89663aefff27 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43377fb5ab3c4ddfb54b3b2cae8eb351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:17:47.374077 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388f871-4fb8-4a5d-8988-89663aefff27 service glance] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:47.374354 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388f871-4fb8-4a5d-8988-89663aefff27 service glance] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:47.374624 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388f871-4fb8-4a5d-8988-89663aefff27 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:47.383844 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388f871-4fb8-4a5d-8988-89663aefff27 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:17:47.385245 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388f871-4fb8-4a5d-8988-89663aefff27 service glance] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:17:47.394755 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 510/1023] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:17:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:17:49.187179 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ab216-6f7d-4517-90e2-5fa0163319fc None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:49.187992 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ab216-6f7d-4517-90e2-5fa0163319fc None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:49.187992 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ab216-6f7d-4517-90e2-5fa0163319fc None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:49.189166 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 514/1024] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:17:49.195160 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addfa10-96f6-47d8-acb9-2bedf9d3e813 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:49.195711 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addfa10-96f6-47d8-acb9-2bedf9d3e813 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:49.195816 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addfa10-96f6-47d8-acb9-2bedf9d3e813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:49.216794 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-0addfa10-96f6-47d8-acb9-2bedf9d3e813 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:17:49.217032 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-0addfa10-96f6-47d8-acb9-2bedf9d3e813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:17:49.225094 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 511/1025] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:17:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:17:49.271231 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ab216-6f7d-4517-90e2-5fa0163319fc None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:17:49.285329 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ab216-6f7d-4517-90e2-5fa0163319fc None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:17:49.291008 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef09fd4-250a-4894-be73-f1263b996712 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:17:49.291665 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef09fd4-250a-4894-be73-f1263b996712 service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:17:49.291958 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef09fd4-250a-4894-be73-f1263b996712 service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:17:49.292240 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef09fd4-250a-4894-be73-f1263b996712 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:17:49.301645 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef09fd4-250a-4894-be73-f1263b996712 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:17:49.303252 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef09fd4-250a-4894-be73-f1263b996712 service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:17:49.315811 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 515/1026] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:17:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:17:59.210852 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=37 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:17:59.308855 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=47 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:18:02.795872 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b16af-91f1-4177-af7f-3a82ea9cb17f None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:02.796574 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b16af-91f1-4177-af7f-3a82ea9cb17f None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:02.796574 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b16af-91f1-4177-af7f-3a82ea9cb17f None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:02.797800 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 512/1027] 10.222.0.65 () {54 vars in 918 bytes} [Wed Jul 27 16:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:18:02.802980 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461bb05-b7e2-43d6-bb7f-d450bc5c5825 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:02.803497 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461bb05-b7e2-43d6-bb7f-d450bc5c5825 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:02.803603 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461bb05-b7e2-43d6-bb7f-d450bc5c5825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:02.823034 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-e461bb05-b7e2-43d6-bb7f-d450bc5c5825 None None] MFA Rules not processed for user `c311ccdc0d434bb6a9ef99da9a5404bf`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:18:02.824189 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-e461bb05-b7e2-43d6-bb7f-d450bc5c5825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:18:02.833180 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 516/1028] 10.222.0.65 () {58 vars in 1015 bytes} [Wed Jul 27 16:18:02 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:18:02.847639 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b70bd-96c0-4e01-8260-41dfeecefa33 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:02.847959 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b70bd-96c0-4e01-8260-41dfeecefa33 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:02.848247 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b70bd-96c0-4e01-8260-41dfeecefa33 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:02.849573 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 513/1029] 10.222.0.65 () {54 vars in 918 bytes} [Wed Jul 27 16:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:18:02.854212 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855dbaf-8edc-4ee7-b490-9ca2835fff8c None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:02.854502 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855dbaf-8edc-4ee7-b490-9ca2835fff8c None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:02.854856 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855dbaf-8edc-4ee7-b490-9ca2835fff8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:02.873637 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-3855dbaf-8edc-4ee7-b490-9ca2835fff8c None None] MFA Rules not processed for user `66768f9443c046b3bd75853a4b2b980e`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:18:02.874840 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-3855dbaf-8edc-4ee7-b490-9ca2835fff8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:18:02.883269 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 517/1030] 10.222.0.65 () {58 vars in 1015 bytes} [Wed Jul 27 16:18:02 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:18:05.560688 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b45391-edc2-4d74-8196-ec7df07350d1 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:05.561280 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b45391-edc2-4d74-8196-ec7df07350d1 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:05.561280 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b45391-edc2-4d74-8196-ec7df07350d1 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:05.563036 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 514/1031] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 16:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:18:05.568859 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c86155-c4ea-4b3c-b8ec-a2ace9791449 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:05.569284 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c86155-c4ea-4b3c-b8ec-a2ace9791449 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:05.569446 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c86155-c4ea-4b3c-b8ec-a2ace9791449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:05.588923 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-e1c86155-c4ea-4b3c-b8ec-a2ace9791449 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:18:05.590336 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-e1c86155-c4ea-4b3c-b8ec-a2ace9791449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:18:05.598333 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 518/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 16:18:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:18:05.641059 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b45391-edc2-4d74-8196-ec7df07350d1 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:18:05.655344 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b45391-edc2-4d74-8196-ec7df07350d1 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:18:05.660928 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe95bfb-548d-4433-9f7c-cc6b74d589c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:18:05.661538 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe95bfb-548d-4433-9f7c-cc6b74d589c3 service nova] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:05.661821 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe95bfb-548d-4433-9f7c-cc6b74d589c3 service nova] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:05.662098 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe95bfb-548d-4433-9f7c-cc6b74d589c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:05.670627 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe95bfb-548d-4433-9f7c-cc6b74d589c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:18:05.672762 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe95bfb-548d-4433-9f7c-cc6b74d589c3 service nova] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:18:05.682586 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 515/1033] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:18:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:18:06.684024 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e7b69-e7ae-4d95-beb3-4b8c2b5ff7e5 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:06.685070 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e7b69-e7ae-4d95-beb3-4b8c2b5ff7e5 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:06.685070 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e7b69-e7ae-4d95-beb3-4b8c2b5ff7e5 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:06.685880 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 519/1034] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 16:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:18:06.692231 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b5373-d9ff-45f6-8d33-14c35782abea None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:06.692740 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b5373-d9ff-45f6-8d33-14c35782abea None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:06.692897 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b5373-d9ff-45f6-8d33-14c35782abea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:06.713873 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-ab2b5373-d9ff-45f6-8d33-14c35782abea None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:18:06.715061 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-ab2b5373-d9ff-45f6-8d33-14c35782abea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:18:06.722932 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 516/1035] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 16:18:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:18:06.949358 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e7b69-e7ae-4d95-beb3-4b8c2b5ff7e5 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:18:06.962499 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e7b69-e7ae-4d95-beb3-4b8c2b5ff7e5 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:18:06.967336 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21806d20-f7dc-42a2-9796-d4ee4e651b99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:18:06.967974 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21806d20-f7dc-42a2-9796-d4ee4e651b99 service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:06.968255 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21806d20-f7dc-42a2-9796-d4ee4e651b99 service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:06.968534 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21806d20-f7dc-42a2-9796-d4ee4e651b99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:06.976982 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21806d20-f7dc-42a2-9796-d4ee4e651b99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:18:06.978564 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21806d20-f7dc-42a2-9796-d4ee4e651b99 service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:18:06.988474 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 520/1036] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:18:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:18:07.908024 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e0342-0ebf-4a42-b90e-67071a189a4d None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:07.908559 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e0342-0ebf-4a42-b90e-67071a189a4d None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:07.908559 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e0342-0ebf-4a42-b90e-67071a189a4d None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:07.909894 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 517/1037] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 16:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:18:07.915402 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d010e-5fe3-4e8d-9b22-f0d05a27e3a1 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:07.915854 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d010e-5fe3-4e8d-9b22-f0d05a27e3a1 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:07.915975 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d010e-5fe3-4e8d-9b22-f0d05a27e3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:07.935773 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-d16d010e-5fe3-4e8d-9b22-f0d05a27e3a1 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:18:07.936988 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-d16d010e-5fe3-4e8d-9b22-f0d05a27e3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:18:07.945484 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 521/1038] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 16:18:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:18:08.102187 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e0342-0ebf-4a42-b90e-67071a189a4d None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:18:08.115819 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e0342-0ebf-4a42-b90e-67071a189a4d None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:18:08.120673 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f062f-0fa3-4187-9b73-713511546e86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:18:08.121299 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f062f-0fa3-4187-9b73-713511546e86 service nova] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:08.121584 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f062f-0fa3-4187-9b73-713511546e86 service nova] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:08.121856 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f062f-0fa3-4187-9b73-713511546e86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:08.130450 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f062f-0fa3-4187-9b73-713511546e86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:18:08.132050 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f062f-0fa3-4187-9b73-713511546e86 service nova] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:18:08.141183 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 518/1039] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:18:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:18:09.016290 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef8371-2260-404b-b660-98f78bb1f7d1 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:09.016869 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef8371-2260-404b-b660-98f78bb1f7d1 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:09.016869 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef8371-2260-404b-b660-98f78bb1f7d1 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:09.018382 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 522/1040] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 16:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:18:09.025209 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff99cfc-f2f0-4995-89fe-cba79dfd10e0 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:09.025974 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff99cfc-f2f0-4995-89fe-cba79dfd10e0 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:09.025974 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff99cfc-f2f0-4995-89fe-cba79dfd10e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:09.045720 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-5ff99cfc-f2f0-4995-89fe-cba79dfd10e0 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:18:09.046960 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-5ff99cfc-f2f0-4995-89fe-cba79dfd10e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:18:09.055859 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 519/1041] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 16:18:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:18:09.210437 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef8371-2260-404b-b660-98f78bb1f7d1 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:18:09.224524 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef8371-2260-404b-b660-98f78bb1f7d1 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:18:09.229541 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c386b-8d22-4627-bb39-56cbd588b465 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:18:09.230156 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c386b-8d22-4627-bb39-56cbd588b465 service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:09.230437 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c386b-8d22-4627-bb39-56cbd588b465 service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:09.230713 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c386b-8d22-4627-bb39-56cbd588b465 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:09.239571 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c386b-8d22-4627-bb39-56cbd588b465 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:18:09.241146 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c386b-8d22-4627-bb39-56cbd588b465 service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:18:09.250321 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 523/1042] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:18:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:18:10.128913 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33098fe1-0335-4e17-bf1b-eeea4426d821 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:10.129485 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33098fe1-0335-4e17-bf1b-eeea4426d821 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:10.129485 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33098fe1-0335-4e17-bf1b-eeea4426d821 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:10.130846 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 520/1043] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 16:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:18:10.135670 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a62c04-85e9-48b9-9820-257bca66c857 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:10.136077 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a62c04-85e9-48b9-9820-257bca66c857 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:10.136226 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a62c04-85e9-48b9-9820-257bca66c857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:10.155882 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-61a62c04-85e9-48b9-9820-257bca66c857 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:18:10.157109 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-61a62c04-85e9-48b9-9820-257bca66c857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:18:10.165070 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 524/1044] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 16:18:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:18:10.319917 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33098fe1-0335-4e17-bf1b-eeea4426d821 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:18:10.333380 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33098fe1-0335-4e17-bf1b-eeea4426d821 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:18:10.338151 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a074f5-4018-48c2-9204-7f8d9ac6d033 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:18:10.338759 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a074f5-4018-48c2-9204-7f8d9ac6d033 service nova] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:10.339042 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a074f5-4018-48c2-9204-7f8d9ac6d033 service nova] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:10.339318 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a074f5-4018-48c2-9204-7f8d9ac6d033 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:10.347314 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a074f5-4018-48c2-9204-7f8d9ac6d033 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:18:10.348902 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a074f5-4018-48c2-9204-7f8d9ac6d033 service nova] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:18:10.358111 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 521/1045] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:18:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:18:11.164287 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d1904-a807-4c8e-9a62-5abd3c9bf03c None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:11.164831 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d1904-a807-4c8e-9a62-5abd3c9bf03c None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:11.164831 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d1904-a807-4c8e-9a62-5abd3c9bf03c None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:11.166192 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 525/1046] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 16:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:18:11.170996 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadb01a-48be-45fb-adc5-edd0dc8f3424 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:11.171405 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadb01a-48be-45fb-adc5-edd0dc8f3424 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:11.171589 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadb01a-48be-45fb-adc5-edd0dc8f3424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:11.190684 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-2cadb01a-48be-45fb-adc5-edd0dc8f3424 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:18:11.191980 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-2cadb01a-48be-45fb-adc5-edd0dc8f3424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:18:11.199884 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 522/1047] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 16:18:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:18:11.355664 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d1904-a807-4c8e-9a62-5abd3c9bf03c None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:18:11.368943 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d1904-a807-4c8e-9a62-5abd3c9bf03c None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:18:11.373870 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96180a3-5fa7-4d2a-b534-b4cd372dd5b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:18:11.374414 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96180a3-5fa7-4d2a-b534-b4cd372dd5b6 service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:11.374699 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96180a3-5fa7-4d2a-b534-b4cd372dd5b6 service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:11.374979 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96180a3-5fa7-4d2a-b534-b4cd372dd5b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:11.383680 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96180a3-5fa7-4d2a-b534-b4cd372dd5b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:18:11.385256 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96180a3-5fa7-4d2a-b534-b4cd372dd5b6 service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:18:11.395456 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 526/1048] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:18:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:18:12.225457 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf180e1-6320-46fa-acd3-9b08fb747917 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:12.226096 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf180e1-6320-46fa-acd3-9b08fb747917 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:12.226096 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf180e1-6320-46fa-acd3-9b08fb747917 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:12.227512 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 523/1049] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 16:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:18:12.233072 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b019dd-6c6b-4892-b0b4-d60a795e46f0 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:12.233594 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b019dd-6c6b-4892-b0b4-d60a795e46f0 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:12.233689 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b019dd-6c6b-4892-b0b4-d60a795e46f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:12.253442 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-e3b019dd-6c6b-4892-b0b4-d60a795e46f0 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:18:12.254625 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-e3b019dd-6c6b-4892-b0b4-d60a795e46f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:18:12.262333 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 527/1050] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 16:18:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:18:12.418218 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf180e1-6320-46fa-acd3-9b08fb747917 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:18:12.432702 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf180e1-6320-46fa-acd3-9b08fb747917 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:18:12.437908 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a57ba-ba9c-4a42-9ddb-9e1008720561 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:18:12.438554 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a57ba-ba9c-4a42-9ddb-9e1008720561 service nova] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:12.438836 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a57ba-ba9c-4a42-9ddb-9e1008720561 service nova] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:12.439116 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a57ba-ba9c-4a42-9ddb-9e1008720561 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:12.448483 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a57ba-ba9c-4a42-9ddb-9e1008720561 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:18:12.450096 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a57ba-ba9c-4a42-9ddb-9e1008720561 service nova] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:18:12.461301 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 524/1051] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:18:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:18:13.287861 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d53727-9fba-4f0e-ae81-346b19687b7b None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:13.288434 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d53727-9fba-4f0e-ae81-346b19687b7b None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:13.288434 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d53727-9fba-4f0e-ae81-346b19687b7b None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:13.289788 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 528/1052] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 16:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:18:13.294864 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf0309-1d73-42e1-bd1e-bf8cdd18ee65 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:13.295326 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf0309-1d73-42e1-bd1e-bf8cdd18ee65 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:13.295470 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf0309-1d73-42e1-bd1e-bf8cdd18ee65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:13.314793 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-4bbf0309-1d73-42e1-bd1e-bf8cdd18ee65 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:18:13.316054 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-4bbf0309-1d73-42e1-bd1e-bf8cdd18ee65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:18:13.324276 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 525/1053] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 16:18:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:18:13.481971 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d53727-9fba-4f0e-ae81-346b19687b7b None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:18:13.495588 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d53727-9fba-4f0e-ae81-346b19687b7b None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:18:13.500934 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5540de-b3f3-4229-aacc-145957723ff1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:18:13.501549 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5540de-b3f3-4229-aacc-145957723ff1 service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:13.501844 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5540de-b3f3-4229-aacc-145957723ff1 service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:13.502114 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5540de-b3f3-4229-aacc-145957723ff1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:13.511005 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5540de-b3f3-4229-aacc-145957723ff1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:18:13.512642 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5540de-b3f3-4229-aacc-145957723ff1 service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:18:13.523112 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 529/1054] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:18:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:18:14.340266 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef133a-4a44-4f60-95c1-045fb169928c None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:14.340898 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef133a-4a44-4f60-95c1-045fb169928c None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:14.341028 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef133a-4a44-4f60-95c1-045fb169928c None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:14.342704 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 526/1055] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 16:18:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:18:14.348579 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486915c-bf4b-4074-93be-0c5d9f2e8685 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:14.348997 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486915c-bf4b-4074-93be-0c5d9f2e8685 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:14.349134 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486915c-bf4b-4074-93be-0c5d9f2e8685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:14.367855 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-4486915c-bf4b-4074-93be-0c5d9f2e8685 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:18:14.369025 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-4486915c-bf4b-4074-93be-0c5d9f2e8685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:18:14.377301 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 530/1056] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 16:18:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:18:14.533937 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef133a-4a44-4f60-95c1-045fb169928c None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:18:14.547614 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef133a-4a44-4f60-95c1-045fb169928c None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:18:14.552469 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a03c3f-ddc6-4d2e-83d9-d49d1b013295 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:18:14.553070 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a03c3f-ddc6-4d2e-83d9-d49d1b013295 service nova] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:14.553350 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a03c3f-ddc6-4d2e-83d9-d49d1b013295 service nova] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:14.553626 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a03c3f-ddc6-4d2e-83d9-d49d1b013295 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:14.561436 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a03c3f-ddc6-4d2e-83d9-d49d1b013295 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:18:14.563583 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a03c3f-ddc6-4d2e-83d9-d49d1b013295 service nova] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:18:14.572605 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 527/1057] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:18:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:18:16.659681 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8596760-39ef-4821-aa34-34bb8799ad42 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:16.660481 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8596760-39ef-4821-aa34-34bb8799ad42 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:16.660481 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8596760-39ef-4821-aa34-34bb8799ad42 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:16.661816 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 531/1058] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 16:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:18:16.666962 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383e60c-e003-496f-a9ad-ae77ec04e556 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:16.667442 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383e60c-e003-496f-a9ad-ae77ec04e556 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:16.667531 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383e60c-e003-496f-a9ad-ae77ec04e556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:16.687612 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-7383e60c-e003-496f-a9ad-ae77ec04e556 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:18:16.688787 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-7383e60c-e003-496f-a9ad-ae77ec04e556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:18:16.696719 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 528/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 16:18:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:18:16.736829 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8596760-39ef-4821-aa34-34bb8799ad42 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:18:16.747355 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8596760-39ef-4821-aa34-34bb8799ad42 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:18:16.750870 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ec750-af04-41ab-b2d4-2d22d8f075b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:18:16.751549 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ec750-af04-41ab-b2d4-2d22d8f075b0 service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:16.751834 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ec750-af04-41ab-b2d4-2d22d8f075b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:16.752108 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ec750-af04-41ab-b2d4-2d22d8f075b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:16.761230 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ec750-af04-41ab-b2d4-2d22d8f075b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:18:16.762668 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ec750-af04-41ab-b2d4-2d22d8f075b0 service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:18:16.772038 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 532/1060] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:18:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:18:19.111177 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9f922-fa0c-4297-92a4-8588a2674997 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:19.111763 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9f922-fa0c-4297-92a4-8588a2674997 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:19.111763 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9f922-fa0c-4297-92a4-8588a2674997 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:19.113111 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 529/1061] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 16:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:18:19.118261 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d6395-6942-4348-a21a-f15297eb9d6f None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:19.118712 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d6395-6942-4348-a21a-f15297eb9d6f None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:19.118849 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d6395-6942-4348-a21a-f15297eb9d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:19.138557 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-238d6395-6942-4348-a21a-f15297eb9d6f None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:18:19.139780 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-238d6395-6942-4348-a21a-f15297eb9d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:18:19.148218 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 533/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 16:18:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:18:19.189526 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9f922-fa0c-4297-92a4-8588a2674997 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:18:19.200295 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9f922-fa0c-4297-92a4-8588a2674997 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:18:19.204529 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0ec5b-0d55-4d13-a23d-a188e1570156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:18:19.205138 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0ec5b-0d55-4d13-a23d-a188e1570156 service neutron] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:19.205421 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0ec5b-0d55-4d13-a23d-a188e1570156 service neutron] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:19.205696 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0ec5b-0d55-4d13-a23d-a188e1570156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:19.214777 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0ec5b-0d55-4d13-a23d-a188e1570156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:18:19.216218 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0ec5b-0d55-4d13-a23d-a188e1570156 service neutron] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:18:19.225482 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 530/1063] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:18:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:18:21.828969 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303ce2e-b1a0-47c0-914b-2f230eda6a88 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:21.829542 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303ce2e-b1a0-47c0-914b-2f230eda6a88 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:21.829542 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303ce2e-b1a0-47c0-914b-2f230eda6a88 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:21.830827 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 534/1064] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 16:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:18:21.836388 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25847de-a698-4a0a-9111-7c2e03c0202a None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:21.836899 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25847de-a698-4a0a-9111-7c2e03c0202a None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:21.836899 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25847de-a698-4a0a-9111-7c2e03c0202a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:21.855991 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-c25847de-a698-4a0a-9111-7c2e03c0202a None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:18:21.857162 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-c25847de-a698-4a0a-9111-7c2e03c0202a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:18:21.865436 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 531/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 16:18:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:18:21.904730 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303ce2e-b1a0-47c0-914b-2f230eda6a88 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:18:21.918871 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303ce2e-b1a0-47c0-914b-2f230eda6a88 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:18:21.923163 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906422e7-e700-476e-8a03-23f73f5c9d7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:18:21.923810 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906422e7-e700-476e-8a03-23f73f5c9d7b service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:21.924095 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906422e7-e700-476e-8a03-23f73f5c9d7b service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:21.924373 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906422e7-e700-476e-8a03-23f73f5c9d7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:21.935361 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906422e7-e700-476e-8a03-23f73f5c9d7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:18:21.936822 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906422e7-e700-476e-8a03-23f73f5c9d7b service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:18:21.946193 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 535/1066] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:18:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:18:24.305746 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cac06c-fdf8-4fc9-8af6-661d67c036ed None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:24.306286 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cac06c-fdf8-4fc9-8af6-661d67c036ed None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:24.306286 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cac06c-fdf8-4fc9-8af6-661d67c036ed None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:24.307709 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 532/1067] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 16:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:18:24.313068 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797bb9c-3918-4297-a0b4-a1807c2d9108 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:24.313509 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797bb9c-3918-4297-a0b4-a1807c2d9108 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:24.313612 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797bb9c-3918-4297-a0b4-a1807c2d9108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:24.332486 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-b797bb9c-3918-4297-a0b4-a1807c2d9108 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:18:24.333685 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-b797bb9c-3918-4297-a0b4-a1807c2d9108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:18:24.341483 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 536/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 16:18:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:18:24.381760 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cac06c-fdf8-4fc9-8af6-661d67c036ed None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:18:24.392451 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cac06c-fdf8-4fc9-8af6-661d67c036ed None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:18:24.395975 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370d9de-c6a6-460a-a367-31a440ec078e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:18:24.396511 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370d9de-c6a6-460a-a367-31a440ec078e service neutron] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:24.396793 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370d9de-c6a6-460a-a367-31a440ec078e service neutron] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:24.397067 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370d9de-c6a6-460a-a367-31a440ec078e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:24.406295 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370d9de-c6a6-460a-a367-31a440ec078e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:18:24.407745 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370d9de-c6a6-460a-a367-31a440ec078e service neutron] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:18:24.417237 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 533/1069] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:18:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:18:26.685142 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5be959-ee39-4bcd-a9f8-57bb0e77ee2d None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:26.685638 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5be959-ee39-4bcd-a9f8-57bb0e77ee2d None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:26.685745 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5be959-ee39-4bcd-a9f8-57bb0e77ee2d None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:26.687622 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 537/1070] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 16:18:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:18:26.692881 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0633c0f-0b6f-44b9-aafc-a4aca046e7e5 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:26.693267 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0633c0f-0b6f-44b9-aafc-a4aca046e7e5 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:26.693369 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0633c0f-0b6f-44b9-aafc-a4aca046e7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:26.712782 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-a0633c0f-0b6f-44b9-aafc-a4aca046e7e5 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:18:26.713987 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-a0633c0f-0b6f-44b9-aafc-a4aca046e7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:18:26.721898 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 534/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 16:18:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:18:26.761077 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5be959-ee39-4bcd-a9f8-57bb0e77ee2d None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:18:26.772491 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5be959-ee39-4bcd-a9f8-57bb0e77ee2d None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:18:26.775956 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988faf00-46b4-494c-8200-cd1988fa6059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:18:26.776603 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988faf00-46b4-494c-8200-cd1988fa6059 service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:26.776886 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988faf00-46b4-494c-8200-cd1988fa6059 service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:26.777160 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988faf00-46b4-494c-8200-cd1988fa6059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:26.787350 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988faf00-46b4-494c-8200-cd1988fa6059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:18:26.788892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988faf00-46b4-494c-8200-cd1988fa6059 service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:18:26.802189 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 538/1072] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:18:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:18:29.056853 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a8c3a-f051-45fe-a31b-a2959f39adeb None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:29.057395 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a8c3a-f051-45fe-a31b-a2959f39adeb None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:29.057395 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a8c3a-f051-45fe-a31b-a2959f39adeb None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:29.058731 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 535/1073] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 16:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:18:29.065276 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc810571-f924-4a2d-beba-d5f5a3beef25 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:29.065724 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc810571-f924-4a2d-beba-d5f5a3beef25 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:29.065847 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc810571-f924-4a2d-beba-d5f5a3beef25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:29.085173 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-fc810571-f924-4a2d-beba-d5f5a3beef25 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:18:29.086805 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-fc810571-f924-4a2d-beba-d5f5a3beef25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:18:29.095274 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 539/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 16:18:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:18:29.133377 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a8c3a-f051-45fe-a31b-a2959f39adeb None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:18:29.144363 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a8c3a-f051-45fe-a31b-a2959f39adeb None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:18:29.147852 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a2db6-6005-4b80-8de7-3a09d6051db1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:18:29.148450 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a2db6-6005-4b80-8de7-3a09d6051db1 service neutron] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:29.148733 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a2db6-6005-4b80-8de7-3a09d6051db1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:29.149004 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a2db6-6005-4b80-8de7-3a09d6051db1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:29.158265 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a2db6-6005-4b80-8de7-3a09d6051db1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:18:29.159962 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a2db6-6005-4b80-8de7-3a09d6051db1 service neutron] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:18:29.169047 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 536/1075] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:18:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:18:31.443821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b9745-9cd0-4006-8b9a-b79589b8917d None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:31.444364 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b9745-9cd0-4006-8b9a-b79589b8917d None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:31.444364 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b9745-9cd0-4006-8b9a-b79589b8917d None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:31.445742 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 540/1076] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 16:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:18:31.451014 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381430c-12d5-445f-858d-9cb4e2699fb7 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:31.451554 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381430c-12d5-445f-858d-9cb4e2699fb7 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:31.451669 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381430c-12d5-445f-858d-9cb4e2699fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:31.459000 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=70 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:18:31.471797 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-c381430c-12d5-445f-858d-9cb4e2699fb7 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:18:31.473000 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-c381430c-12d5-445f-858d-9cb4e2699fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:18:31.480858 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 537/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 16:18:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:18:31.520092 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b9745-9cd0-4006-8b9a-b79589b8917d None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:18:31.525673 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=73 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:18:31.531870 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b9745-9cd0-4006-8b9a-b79589b8917d None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:18:31.535637 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961aa96-2c39-4917-8a39-f4174b330325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:18:31.536252 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961aa96-2c39-4917-8a39-f4174b330325 service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:31.536539 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961aa96-2c39-4917-8a39-f4174b330325 service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:31.536822 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961aa96-2c39-4917-8a39-f4174b330325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:31.546281 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961aa96-2c39-4917-8a39-f4174b330325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:18:31.547756 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961aa96-2c39-4917-8a39-f4174b330325 service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:18:31.556947 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 541/1078] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:18:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:18:33.864324 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e945f-6381-4848-93ec-c0bb39c9f28c None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:33.864883 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e945f-6381-4848-93ec-c0bb39c9f28c None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:33.864883 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e945f-6381-4848-93ec-c0bb39c9f28c None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:33.866178 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 538/1079] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 16:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:18:33.871639 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8037882-4f19-4535-80c6-764c9cb0797b None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:33.872073 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8037882-4f19-4535-80c6-764c9cb0797b None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:33.872224 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8037882-4f19-4535-80c6-764c9cb0797b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:33.892062 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-a8037882-4f19-4535-80c6-764c9cb0797b None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:18:33.893262 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-a8037882-4f19-4535-80c6-764c9cb0797b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:18:33.900909 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 542/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 16:18:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:18:33.940212 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e945f-6381-4848-93ec-c0bb39c9f28c None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:18:33.950974 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e945f-6381-4848-93ec-c0bb39c9f28c None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:18:33.954576 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9be9e2-edf1-4b7c-9332-583f979f9e46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:18:33.955184 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9be9e2-edf1-4b7c-9332-583f979f9e46 service neutron] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:33.955500 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9be9e2-edf1-4b7c-9332-583f979f9e46 service neutron] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:33.955783 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9be9e2-edf1-4b7c-9332-583f979f9e46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:33.964494 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9be9e2-edf1-4b7c-9332-583f979f9e46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:18:33.965916 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9be9e2-edf1-4b7c-9332-583f979f9e46 service neutron] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:18:33.975938 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 539/1081] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:18:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:18:36.244040 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c68a8-e902-437b-af28-fc2f7c2cbeb9 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:36.244687 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c68a8-e902-437b-af28-fc2f7c2cbeb9 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:36.244687 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c68a8-e902-437b-af28-fc2f7c2cbeb9 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:36.246018 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 543/1082] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 16:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:18:36.251709 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060dba4-0d0a-41e4-bec5-34db1527928c None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:36.252142 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060dba4-0d0a-41e4-bec5-34db1527928c None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:36.252434 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060dba4-0d0a-41e4-bec5-34db1527928c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:36.271429 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-f060dba4-0d0a-41e4-bec5-34db1527928c None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:18:36.272631 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-f060dba4-0d0a-41e4-bec5-34db1527928c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:18:36.280993 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 540/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 16:18:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:18:36.319209 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c68a8-e902-437b-af28-fc2f7c2cbeb9 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:18:36.330063 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c68a8-e902-437b-af28-fc2f7c2cbeb9 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:18:36.333514 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9a622-9d96-43c5-b5d8-b3c23a02c3e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:18:36.334124 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9a622-9d96-43c5-b5d8-b3c23a02c3e3 service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:36.334406 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9a622-9d96-43c5-b5d8-b3c23a02c3e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:36.334681 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9a622-9d96-43c5-b5d8-b3c23a02c3e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:36.344625 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9a622-9d96-43c5-b5d8-b3c23a02c3e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:18:36.346315 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9a622-9d96-43c5-b5d8-b3c23a02c3e3 service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:18:36.359390 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 544/1084] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:18:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:18:38.603380 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bccc4-f92d-4a5c-ba96-a94a0be7d5d9 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:38.603967 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bccc4-f92d-4a5c-ba96-a94a0be7d5d9 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:38.603967 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bccc4-f92d-4a5c-ba96-a94a0be7d5d9 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:38.605310 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 541/1085] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 16:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:18:38.610500 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59e1a8-16fb-49c7-a95e-e3fc14310dfe None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:38.610932 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59e1a8-16fb-49c7-a95e-e3fc14310dfe None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:38.611056 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59e1a8-16fb-49c7-a95e-e3fc14310dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:38.630506 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-5b59e1a8-16fb-49c7-a95e-e3fc14310dfe None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:18:38.631816 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-5b59e1a8-16fb-49c7-a95e-e3fc14310dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:18:38.640160 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 545/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 16:18:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:18:38.677593 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bccc4-f92d-4a5c-ba96-a94a0be7d5d9 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:18:38.690738 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bccc4-f92d-4a5c-ba96-a94a0be7d5d9 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:18:38.694301 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6c3b8-bd56-4f68-b2cf-63ddafedb241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:18:38.694919 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6c3b8-bd56-4f68-b2cf-63ddafedb241 service neutron] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:18:38.695201 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6c3b8-bd56-4f68-b2cf-63ddafedb241 service neutron] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:18:38.695515 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6c3b8-bd56-4f68-b2cf-63ddafedb241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:18:38.705444 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde6c3b8-bd56-4f68-b2cf-63ddafedb241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:18:38.706864 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde6c3b8-bd56-4f68-b2cf-63ddafedb241 service neutron] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:18:38.716885 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 542/1087] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:18:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:18:48.625517 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=17 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:18:48.712478 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=17 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:19:02.629078 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e1d6c-5652-4ed7-b694-03ee45397df1 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:19:02.629643 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e1d6c-5652-4ed7-b694-03ee45397df1 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:19:02.629643 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e1d6c-5652-4ed7-b694-03ee45397df1 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:19:02.631122 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 546/1088] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:19:02.636970 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e88417-8c89-4eae-b336-7c7eec6b0080 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:19:02.637382 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e88417-8c89-4eae-b336-7c7eec6b0080 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:19:02.637541 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e88417-8c89-4eae-b336-7c7eec6b0080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:19:02.656748 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-18e88417-8c89-4eae-b336-7c7eec6b0080 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:19:02.658205 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-18e88417-8c89-4eae-b336-7c7eec6b0080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:19:02.666107 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 543/1089] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:19:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:19:02.716423 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf3b2c-30df-4ffd-961f-2614304acfa1 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:19:02.716716 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf3b2c-30df-4ffd-961f-2614304acfa1 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:19:02.717002 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf3b2c-30df-4ffd-961f-2614304acfa1 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:19:02.718334 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 547/1090] 10.222.0.65 () {54 vars in 966 bytes} [Wed Jul 27 16:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:19:02.723480 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3278f-c4cf-4a65-a026-e043ab09e9f1 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:19:02.723771 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3278f-c4cf-4a65-a026-e043ab09e9f1 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:19:02.724052 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3278f-c4cf-4a65-a026-e043ab09e9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:19:02.745025 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-b0a3278f-c4cf-4a65-a026-e043ab09e9f1 None None] MFA Rules not processed for user `43377fb5ab3c4ddfb54b3b2cae8eb351`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:19:02.746906 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-b0a3278f-c4cf-4a65-a026-e043ab09e9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:19:02.754204 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 544/1091] 10.222.0.65 () {58 vars in 1063 bytes} [Wed Jul 27 16:19:02 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:19:02.761711 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf3b2c-30df-4ffd-961f-2614304acfa1 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:19:02.772352 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf3b2c-30df-4ffd-961f-2614304acfa1 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:19:02.775970 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffdd14-525d-4564-906b-585cf14f3d97 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43377fb5ab3c4ddfb54b3b2cae8eb351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:19:02.776585 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffdd14-525d-4564-906b-585cf14f3d97 service glance] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:19:02.776901 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffdd14-525d-4564-906b-585cf14f3d97 service glance] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:19:02.777184 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffdd14-525d-4564-906b-585cf14f3d97 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:19:02.786367 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ffdd14-525d-4564-906b-585cf14f3d97 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:19:02.787830 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ffdd14-525d-4564-906b-585cf14f3d97 service glance] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:19:02.797631 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 548/1092] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:19:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:19:05.120343 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b0cd5-0870-49ef-ad66-3a30535ef652 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:19:05.121508 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b0cd5-0870-49ef-ad66-3a30535ef652 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:19:05.121508 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b0cd5-0870-49ef-ad66-3a30535ef652 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:19:05.122829 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 545/1093] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:19:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:19:05.128155 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b51f1-b9df-4964-b629-b0d995427aa0 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:19:05.128585 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b51f1-b9df-4964-b629-b0d995427aa0 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:19:05.128724 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b51f1-b9df-4964-b629-b0d995427aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:19:05.147396 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-aa0b51f1-b9df-4964-b629-b0d995427aa0 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:19:05.148600 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-aa0b51f1-b9df-4964-b629-b0d995427aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:19:05.156475 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 549/1094] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:19:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:19:05.180674 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b0cd5-0870-49ef-ad66-3a30535ef652 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:19:05.193735 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b0cd5-0870-49ef-ad66-3a30535ef652 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:19:05.198407 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c71ec-7008-46bf-9b08-d74f8454f052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:19:05.199125 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c71ec-7008-46bf-9b08-d74f8454f052 admin admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:19:05.199437 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c71ec-7008-46bf-9b08-d74f8454f052 admin admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:19:05.199718 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c71ec-7008-46bf-9b08-d74f8454f052 admin admin] PATH_INFO: `/v3/projects` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:19:05.200407 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c71ec-7008-46bf-9b08-d74f8454f052 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:19:05.202165 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: WARNING py.warnings [None req-9a9c71ec-7008-46bf-9b08-d74f8454f052 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:19:05.202165 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: warnings.warn(msg) Jul 27 16:19:05.202165 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: Jul 27 16:19:05.203315 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c71ec-7008-46bf-9b08-d74f8454f052 admin admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:19:05.221470 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 546/1095] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 16:19:05 2022] GET /identity/v3/projects => generated 1606 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:19:07.466009 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49fcd0-599d-40d3-9e3a-37f2e0ed39c6 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:19:07.466604 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49fcd0-599d-40d3-9e3a-37f2e0ed39c6 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:19:07.466725 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49fcd0-599d-40d3-9e3a-37f2e0ed39c6 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:19:07.468141 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 550/1096] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:19:07.473580 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c0040-1467-4070-a81e-a0db5bab496f None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:19:07.474025 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c0040-1467-4070-a81e-a0db5bab496f None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:19:07.474125 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c0040-1467-4070-a81e-a0db5bab496f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:19:07.493847 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-205c0040-1467-4070-a81e-a0db5bab496f None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:19:07.495044 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-205c0040-1467-4070-a81e-a0db5bab496f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:19:07.503718 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 547/1097] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:19:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:19:07.549216 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49fcd0-599d-40d3-9e3a-37f2e0ed39c6 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:19:07.563530 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49fcd0-599d-40d3-9e3a-37f2e0ed39c6 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:19:07.568486 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf420606-7768-46f1-91c4-6fdf83506356 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:19:07.569096 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf420606-7768-46f1-91c4-6fdf83506356 service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:19:07.569385 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf420606-7768-46f1-91c4-6fdf83506356 service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:19:07.569660 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf420606-7768-46f1-91c4-6fdf83506356 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:19:07.578012 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf420606-7768-46f1-91c4-6fdf83506356 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:19:07.579638 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf420606-7768-46f1-91c4-6fdf83506356 service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:19:07.588967 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 551/1098] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:19:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:19:09.990391 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85797c-b22f-4243-a714-b9f6e428c716 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:19:09.990903 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85797c-b22f-4243-a714-b9f6e428c716 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:19:09.990903 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85797c-b22f-4243-a714-b9f6e428c716 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:19:09.992352 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 548/1099] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:19:09.998092 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17e762-419f-4be8-8b17-52c1d8a45b2d None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:19:09.998648 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17e762-419f-4be8-8b17-52c1d8a45b2d None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:19:09.998648 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17e762-419f-4be8-8b17-52c1d8a45b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:19:10.019392 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-ed17e762-419f-4be8-8b17-52c1d8a45b2d None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:19:10.021439 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-ed17e762-419f-4be8-8b17-52c1d8a45b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:19:10.029724 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 552/1100] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:19:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:19:10.074160 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85797c-b22f-4243-a714-b9f6e428c716 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:19:10.084785 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85797c-b22f-4243-a714-b9f6e428c716 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:19:10.088247 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3ce9a-b701-458b-b130-cfcc3545d210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:19:10.088865 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3ce9a-b701-458b-b130-cfcc3545d210 service neutron] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:19:10.089175 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3ce9a-b701-458b-b130-cfcc3545d210 service neutron] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:19:10.089452 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3ce9a-b701-458b-b130-cfcc3545d210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:19:10.098311 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3ce9a-b701-458b-b130-cfcc3545d210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:19:10.099779 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3ce9a-b701-458b-b130-cfcc3545d210 service neutron] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:19:10.109183 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 549/1101] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:19:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:19:12.380148 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4db32-7a7a-4f5b-8742-8d75177c9551 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:19:12.380686 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4db32-7a7a-4f5b-8742-8d75177c9551 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:19:12.380686 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4db32-7a7a-4f5b-8742-8d75177c9551 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:19:12.382229 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 553/1102] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:19:12.387791 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26d9d2-52fc-4bdb-81bd-ecdaf45d74df None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:19:12.388222 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26d9d2-52fc-4bdb-81bd-ecdaf45d74df None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:19:12.388357 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26d9d2-52fc-4bdb-81bd-ecdaf45d74df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:19:12.407998 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-8e26d9d2-52fc-4bdb-81bd-ecdaf45d74df None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:19:12.409193 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-8e26d9d2-52fc-4bdb-81bd-ecdaf45d74df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:19:12.417889 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 550/1103] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:19:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:19:12.456886 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4db32-7a7a-4f5b-8742-8d75177c9551 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:19:12.468669 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4db32-7a7a-4f5b-8742-8d75177c9551 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:19:12.472716 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03c1c4-a072-4ce6-90ab-d3bb32a3c22e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:19:12.473358 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03c1c4-a072-4ce6-90ab-d3bb32a3c22e service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:19:12.473638 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03c1c4-a072-4ce6-90ab-d3bb32a3c22e service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:19:12.473910 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03c1c4-a072-4ce6-90ab-d3bb32a3c22e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:19:12.484097 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03c1c4-a072-4ce6-90ab-d3bb32a3c22e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:19:12.485563 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03c1c4-a072-4ce6-90ab-d3bb32a3c22e service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:19:12.496041 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 554/1104] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:19:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:19:14.907355 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67f42f-2cd2-4f56-91ee-120e7e6cfa45 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:19:14.907908 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67f42f-2cd2-4f56-91ee-120e7e6cfa45 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:19:14.908042 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67f42f-2cd2-4f56-91ee-120e7e6cfa45 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:19:14.909416 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 551/1105] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:19:14.915201 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc33b8-9a39-47e0-bac4-baf63a5026d2 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:19:14.915668 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc33b8-9a39-47e0-bac4-baf63a5026d2 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:19:14.915812 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc33b8-9a39-47e0-bac4-baf63a5026d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:19:14.935904 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-22dc33b8-9a39-47e0-bac4-baf63a5026d2 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:19:14.937034 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-22dc33b8-9a39-47e0-bac4-baf63a5026d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:19:14.944744 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 555/1106] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:19:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:19:14.985588 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67f42f-2cd2-4f56-91ee-120e7e6cfa45 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:19:14.997196 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67f42f-2cd2-4f56-91ee-120e7e6cfa45 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:19:15.000807 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85acd9f-583b-4e61-b919-2bfcb491c965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:19:15.001419 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85acd9f-583b-4e61-b919-2bfcb491c965 service neutron] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:19:15.001728 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85acd9f-583b-4e61-b919-2bfcb491c965 service neutron] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:19:15.002013 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85acd9f-583b-4e61-b919-2bfcb491c965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:19:15.011144 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85acd9f-583b-4e61-b919-2bfcb491c965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:19:15.012620 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85acd9f-583b-4e61-b919-2bfcb491c965 service neutron] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:19:15.022128 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 552/1107] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:19:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:19:17.517844 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d26a55-d2b4-40c3-9864-a30f3a55c3a0 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:19:17.518416 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d26a55-d2b4-40c3-9864-a30f3a55c3a0 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:19:17.518416 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d26a55-d2b4-40c3-9864-a30f3a55c3a0 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:19:17.519780 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 556/1108] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 16:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:19:17.525043 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448a75d-f52e-4859-887e-0c40b9b2cb0f None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:19:17.525451 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448a75d-f52e-4859-887e-0c40b9b2cb0f None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:19:17.525604 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448a75d-f52e-4859-887e-0c40b9b2cb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:19:17.546227 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-e448a75d-f52e-4859-887e-0c40b9b2cb0f None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:19:17.547464 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-e448a75d-f52e-4859-887e-0c40b9b2cb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:19:17.557295 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 553/1109] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 16:19:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:19:17.597664 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d26a55-d2b4-40c3-9864-a30f3a55c3a0 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:19:17.609351 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d26a55-d2b4-40c3-9864-a30f3a55c3a0 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:19:17.612883 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec703f-cb37-4d7f-855e-7cb507a8d876 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:19:17.613495 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec703f-cb37-4d7f-855e-7cb507a8d876 service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:19:17.613780 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec703f-cb37-4d7f-855e-7cb507a8d876 service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:19:17.614057 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec703f-cb37-4d7f-855e-7cb507a8d876 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:19:17.623057 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec703f-cb37-4d7f-855e-7cb507a8d876 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:19:17.625234 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec703f-cb37-4d7f-855e-7cb507a8d876 service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:19:17.634484 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 557/1110] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:19:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:19:27.540611 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=33 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:19:27.630515 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=33 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:53.689151 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d970b-ab61-42b1-93a3-9b878d23b460 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:53.689790 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d970b-ab61-42b1-93a3-9b878d23b460 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:53.689790 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d970b-ab61-42b1-93a3-9b878d23b460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:53.709998 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-b41d970b-ab61-42b1-93a3-9b878d23b460 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:53.711184 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-b41d970b-ab61-42b1-93a3-9b878d23b460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:53.718865 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 554/1111] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 16:20:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:20:53.726827 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bf4b9-3a5e-4a6c-b737-9a6d36e14020 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:53.727328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bf4b9-3a5e-4a6c-b737-9a6d36e14020 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:53.727486 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bf4b9-3a5e-4a6c-b737-9a6d36e14020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:53.748141 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-220bf4b9-3a5e-4a6c-b737-9a6d36e14020 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:53.749405 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-220bf4b9-3a5e-4a6c-b737-9a6d36e14020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:53.757865 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 558/1112] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 16:20:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:20:53.762486 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d970b-ab61-42b1-93a3-9b878d23b460 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:53.772777 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d970b-ab61-42b1-93a3-9b878d23b460 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:53.777523 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b184817-c004-49f4-8781-634d95cc5539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:53.778138 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b184817-c004-49f4-8781-634d95cc5539 admin admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:53.778420 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b184817-c004-49f4-8781-634d95cc5539 admin admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:53.778697 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b184817-c004-49f4-8781-634d95cc5539 admin admin] PATH_INFO: `/v3/domains` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:53.779439 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b184817-c004-49f4-8781-634d95cc5539 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:53.780001 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b184817-c004-49f4-8781-634d95cc5539 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:53.781002 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: WARNING py.warnings [None req-8b184817-c004-49f4-8781-634d95cc5539 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:20:53.781002 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: warnings.warn(msg) Jul 27 16:20:53.781002 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: Jul 27 16:20:53.781900 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b184817-c004-49f4-8781-634d95cc5539 admin admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:53.793442 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 555/1113] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 16:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:53.801842 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220bf4b9-3a5e-4a6c-b737-9a6d36e14020 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:53.810969 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220bf4b9-3a5e-4a6c-b737-9a6d36e14020 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:53.815501 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e33263-6a97-44bc-8a1d-c483f2decc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:53.816113 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e33263-6a97-44bc-8a1d-c483f2decc54 admin admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:53.816398 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e33263-6a97-44bc-8a1d-c483f2decc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:53.816674 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e33263-6a97-44bc-8a1d-c483f2decc54 admin admin] PATH_INFO: `/v3/projects` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:53.817330 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e33263-6a97-44bc-8a1d-c483f2decc54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:53.819731 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: WARNING py.warnings [None req-e5e33263-6a97-44bc-8a1d-c483f2decc54 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:20:53.819731 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: warnings.warn(msg) Jul 27 16:20:53.819731 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: Jul 27 16:20:53.820929 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e33263-6a97-44bc-8a1d-c483f2decc54 admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:53.849447 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 559/1114] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 16:20:53 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:20:53.853639 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b184817-c004-49f4-8781-634d95cc5539 admin admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:53.863840 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b184817-c004-49f4-8781-634d95cc5539 admin admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:53.921514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b6bb1-ce56-4d92-bdde-697b14bb5452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:53.922068 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b6bb1-ce56-4d92-bdde-697b14bb5452 admin admin] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:53.922355 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b6bb1-ce56-4d92-bdde-697b14bb5452 admin admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:53.922632 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b6bb1-ce56-4d92-bdde-697b14bb5452 admin admin] PATH_INFO: `/v3/users` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:53.923310 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b6bb1-ce56-4d92-bdde-697b14bb5452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:53.924350 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: WARNING py.warnings [None req-a50b6bb1-ce56-4d92-bdde-697b14bb5452 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:20:53.924350 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: warnings.warn(msg) Jul 27 16:20:53.924350 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: Jul 27 16:20:53.925582 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b6bb1-ce56-4d92-bdde-697b14bb5452 admin admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:53.947291 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 556/1115] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 16:20:53 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:20:53.951513 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e33263-6a97-44bc-8a1d-c483f2decc54 admin admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:53.962263 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e33263-6a97-44bc-8a1d-c483f2decc54 admin admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:53.966791 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add61985-e3a6-48bf-a84d-9d37131d4ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:53.967426 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add61985-e3a6-48bf-a84d-9d37131d4ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:53.967713 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add61985-e3a6-48bf-a84d-9d37131d4ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:53.967988 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add61985-e3a6-48bf-a84d-9d37131d4ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:53.968675 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add61985-e3a6-48bf-a84d-9d37131d4ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:53.969694 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: WARNING py.warnings [None req-add61985-e3a6-48bf-a84d-9d37131d4ef0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:20:53.969694 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: warnings.warn(msg) Jul 27 16:20:53.969694 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: Jul 27 16:20:53.970581 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add61985-e3a6-48bf-a84d-9d37131d4ef0 admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:53.983220 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 560/1116] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 16:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:20:53.987166 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b6bb1-ce56-4d92-bdde-697b14bb5452 admin admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:53.996885 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b6bb1-ce56-4d92-bdde-697b14bb5452 admin admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:54.001396 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e7a0f-128a-4708-8275-d422836ea1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:54.002003 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e7a0f-128a-4708-8275-d422836ea1db admin admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:54.002286 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e7a0f-128a-4708-8275-d422836ea1db admin admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:54.002562 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e7a0f-128a-4708-8275-d422836ea1db admin admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:54.003282 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e7a0f-128a-4708-8275-d422836ea1db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:54.004312 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: WARNING py.warnings [None req-577e7a0f-128a-4708-8275-d422836ea1db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:20:54.004312 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: warnings.warn(msg) Jul 27 16:20:54.004312 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: Jul 27 16:20:54.005210 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e7a0f-128a-4708-8275-d422836ea1db admin admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:54.018908 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 557/1117] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 16:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:20:54.024210 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add61985-e3a6-48bf-a84d-9d37131d4ef0 admin admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:54.034160 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add61985-e3a6-48bf-a84d-9d37131d4ef0 admin admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:54.038767 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb5393-30c5-4a04-9187-a52d58706e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:54.039470 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb5393-30c5-4a04-9187-a52d58706e4e admin admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:54.039758 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb5393-30c5-4a04-9187-a52d58706e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:54.040037 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb5393-30c5-4a04-9187-a52d58706e4e admin admin] PATH_INFO: `/v3/projects/83b285ca60ba4aa59450b1eeb0b4a842/users/e34b7164ec1243d692d614ddd58fee0b/roles/5698bc4d332140e9af77ddcbb9915736` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:54.054595 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb5393-30c5-4a04-9187-a52d58706e4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=83b285ca60ba4aa59450b1eeb0b4a842, user_id=e34b7164ec1243d692d614ddd58fee0b, role_id=5698bc4d332140e9af77ddcbb9915736)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:54.055653 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: WARNING py.warnings [None req-e9eb5393-30c5-4a04-9187-a52d58706e4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:20:54.055653 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: warnings.warn(msg) Jul 27 16:20:54.055653 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: Jul 27 16:20:54.057595 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb5393-30c5-4a04-9187-a52d58706e4e admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:54.071080 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 561/1118] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 16:20:54 2022] PUT /identity/v3/projects/83b285ca60ba4aa59450b1eeb0b4a842/users/e34b7164ec1243d692d614ddd58fee0b/roles/5698bc4d332140e9af77ddcbb9915736 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:20:54.083193 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a5971-bb6c-4241-82bb-cf058a64dd73 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:54.083525 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a5971-bb6c-4241-82bb-cf058a64dd73 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:54.083810 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a5971-bb6c-4241-82bb-cf058a64dd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:54.111007 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-a86a5971-bb6c-4241-82bb-cf058a64dd73 None None] MFA Rules not processed for user `e34b7164ec1243d692d614ddd58fee0b`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:54.112236 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-a86a5971-bb6c-4241-82bb-cf058a64dd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:54.175219 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 558/1119] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 16:20:54 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:20:54.188704 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c2c6f-0df1-416c-8913-60d5a0091c28 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:54.189005 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c2c6f-0df1-416c-8913-60d5a0091c28 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:54.189291 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c2c6f-0df1-416c-8913-60d5a0091c28 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:54.190678 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 562/1120] 10.222.0.65 () {54 vars in 964 bytes} [Wed Jul 27 16:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:54.196004 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ce0f7-91a7-41d8-bfd8-53f15f83b51c None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:54.196293 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ce0f7-91a7-41d8-bfd8-53f15f83b51c None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:54.196569 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ce0f7-91a7-41d8-bfd8-53f15f83b51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:54.215849 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-112ce0f7-91a7-41d8-bfd8-53f15f83b51c None None] MFA Rules not processed for user `4b6d1f7acba3415f84c2f01b66190b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:54.217024 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-112ce0f7-91a7-41d8-bfd8-53f15f83b51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:54.259858 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:54.268159 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 559/1121] 10.222.0.65 () {58 vars in 1061 bytes} [Wed Jul 27 16:20:54 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:20:54.276067 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c2c6f-0df1-416c-8913-60d5a0091c28 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:54.286727 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c2c6f-0df1-416c-8913-60d5a0091c28 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:54.290286 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da176a-08b1-4614-88ba-4f742d96fcfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6d1f7acba3415f84c2f01b66190b8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:54.290892 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da176a-08b1-4614-88ba-4f742d96fcfa service cinder] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:54.291172 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da176a-08b1-4614-88ba-4f742d96fcfa service cinder] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:54.291476 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da176a-08b1-4614-88ba-4f742d96fcfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:54.299799 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da176a-08b1-4614-88ba-4f742d96fcfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:54.301218 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da176a-08b1-4614-88ba-4f742d96fcfa service cinder] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:54.310512 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 563/1122] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:20:54 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:20:54.348129 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e28b5-29ff-4994-9d5a-4086e028b89f None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:54.348422 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e28b5-29ff-4994-9d5a-4086e028b89f None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:54.348701 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e28b5-29ff-4994-9d5a-4086e028b89f None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:54.349964 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 560/1123] 10.222.0.65 () {52 vars in 830 bytes} [Wed Jul 27 16:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:54.353527 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da176a-08b1-4614-88ba-4f742d96fcfa service cinder] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:54.423332 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da176a-08b1-4614-88ba-4f742d96fcfa service cinder] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:54.428506 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10783b5-1ecb-4e7b-a0ad-4356abf37602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:54.429093 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10783b5-1ecb-4e7b-a0ad-4356abf37602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:54.429380 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10783b5-1ecb-4e7b-a0ad-4356abf37602 admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:54.429655 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10783b5-1ecb-4e7b-a0ad-4356abf37602 admin admin] PATH_INFO: `/v3/users/e34b7164ec1243d692d614ddd58fee0b` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:54.430825 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10783b5-1ecb-4e7b-a0ad-4356abf37602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e34b7164ec1243d692d614ddd58fee0b)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:54.431882 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: WARNING py.warnings [None req-d10783b5-1ecb-4e7b-a0ad-4356abf37602 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:20:54.431882 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: warnings.warn(msg) Jul 27 16:20:54.431882 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: Jul 27 16:20:54.433090 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10783b5-1ecb-4e7b-a0ad-4356abf37602 admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:54.497954 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-d10783b5-1ecb-4e7b-a0ad-4356abf37602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e34b7164ec1243d692d614ddd58fee0b'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:20:54.498618 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-d10783b5-1ecb-4e7b-a0ad-4356abf37602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e34b7164ec1243d692d614ddd58fee0b'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:20:54.508530 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-d10783b5-1ecb-4e7b-a0ad-4356abf37602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e34b7164ec1243d692d614ddd58fee0b'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:20:54.509252 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-d10783b5-1ecb-4e7b-a0ad-4356abf37602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e34b7164ec1243d692d614ddd58fee0b'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:20:54.521339 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-d10783b5-1ecb-4e7b-a0ad-4356abf37602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e34b7164ec1243d692d614ddd58fee0b'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:20:54.547084 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 564/1124] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 16:20:54 2022] DELETE /identity/v3/users/e34b7164ec1243d692d614ddd58fee0b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:20:54.551645 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e4528-f3a0-4193-9526-53bb14306f7f None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:54.551938 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e4528-f3a0-4193-9526-53bb14306f7f None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:54.552220 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e4528-f3a0-4193-9526-53bb14306f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:54.571072 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-da3e4528-f3a0-4193-9526-53bb14306f7f None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:54.572299 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-da3e4528-f3a0-4193-9526-53bb14306f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:54.629575 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 561/1125] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 16:20:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:20:54.639108 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10783b5-1ecb-4e7b-a0ad-4356abf37602 admin admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:54.640575 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-d10783b5-1ecb-4e7b-a0ad-4356abf37602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:54.646020 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:54.701541 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10783b5-1ecb-4e7b-a0ad-4356abf37602 admin admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:54.705085 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ee01e-d829-4f46-b97c-22e9bfab8073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:54.705713 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ee01e-d829-4f46-b97c-22e9bfab8073 service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:54.706002 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ee01e-d829-4f46-b97c-22e9bfab8073 service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:54.706279 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ee01e-d829-4f46-b97c-22e9bfab8073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:54.715728 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ee01e-d829-4f46-b97c-22e9bfab8073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:54.717180 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ee01e-d829-4f46-b97c-22e9bfab8073 service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:54.727036 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 565/1126] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:20:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:20:55.079041 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e4528-f3a0-4193-9526-53bb14306f7f None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:55.080653 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-da3e4528-f3a0-4193-9526-53bb14306f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:55.094519 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e4528-f3a0-4193-9526-53bb14306f7f None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:55.099957 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2c7d0-3fca-48a2-ae08-c2ef71c81cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:55.100683 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2c7d0-3fca-48a2-ae08-c2ef71c81cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:55.100977 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2c7d0-3fca-48a2-ae08-c2ef71c81cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:55.101252 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2c7d0-3fca-48a2-ae08-c2ef71c81cb7 admin admin] PATH_INFO: `/v3/projects/83b285ca60ba4aa59450b1eeb0b4a842` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:55.102414 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2c7d0-3fca-48a2-ae08-c2ef71c81cb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83b285ca60ba4aa59450b1eeb0b4a842)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:55.103467 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: WARNING py.warnings [None req-73b2c7d0-3fca-48a2-ae08-c2ef71c81cb7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:20:55.103467 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: warnings.warn(msg) Jul 27 16:20:55.103467 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: Jul 27 16:20:55.104684 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2c7d0-3fca-48a2-ae08-c2ef71c81cb7 admin admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:55.164263 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [None req-73b2c7d0-3fca-48a2-ae08-c2ef71c81cb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83b285ca60ba4aa59450b1eeb0b4a842', 'request_id': 'req-73b2c7d0-3fca-48a2-ae08-c2ef71c81cb7'} {{(pid=87086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:20:55.170314 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [None req-73b2c7d0-3fca-48a2-ae08-c2ef71c81cb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83b285ca60ba4aa59450b1eeb0b4a842', 'request_id': 'req-73b2c7d0-3fca-48a2-ae08-c2ef71c81cb7'} {{(pid=87086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:20:55.180505 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [None req-73b2c7d0-3fca-48a2-ae08-c2ef71c81cb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83b285ca60ba4aa59450b1eeb0b4a842', 'request_id': 'req-73b2c7d0-3fca-48a2-ae08-c2ef71c81cb7'} {{(pid=87086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:20:55.208492 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [None req-73b2c7d0-3fca-48a2-ae08-c2ef71c81cb7 admin admin] The token cache is being invalidate because project 83b285ca60ba4aa59450b1eeb0b4a842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:20:55.208776 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [None req-73b2c7d0-3fca-48a2-ae08-c2ef71c81cb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:20:55.209890 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [None req-73b2c7d0-3fca-48a2-ae08-c2ef71c81cb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:20:55.211561 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 562/1127] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 16:20:55 2022] DELETE /identity/v3/projects/83b285ca60ba4aa59450b1eeb0b4a842 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:21:04.722367 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=25 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:05.205125 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:14.078109 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fc486-e520-443e-ac24-550684d1b405 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:14.078729 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fc486-e520-443e-ac24-550684d1b405 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:14.078729 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fc486-e520-443e-ac24-550684d1b405 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:14.080075 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 566/1128] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 16:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:14.084984 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e3e40-4b27-4b22-ad32-9e67b5f2bf59 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:14.085408 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e3e40-4b27-4b22-ad32-9e67b5f2bf59 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:14.085596 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e3e40-4b27-4b22-ad32-9e67b5f2bf59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:14.291307 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-d69e3e40-4b27-4b22-ad32-9e67b5f2bf59 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:14.292564 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-d69e3e40-4b27-4b22-ad32-9e67b5f2bf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:14.388663 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 563/1129] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 16:22:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:22:14.568637 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fc486-e520-443e-ac24-550684d1b405 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:14.570322 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-470fc486-e520-443e-ac24-550684d1b405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:14.659761 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fc486-e520-443e-ac24-550684d1b405 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:14.665240 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98744eed-284b-4929-9665-37e92704a86a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:14.665860 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98744eed-284b-4929-9665-37e92704a86a service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:14.666143 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98744eed-284b-4929-9665-37e92704a86a service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:14.666422 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98744eed-284b-4929-9665-37e92704a86a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:14.674807 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98744eed-284b-4929-9665-37e92704a86a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:14.676467 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98744eed-284b-4929-9665-37e92704a86a service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:14.685875 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 567/1130] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:22:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:22:15.537878 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f9a7f-70ff-4f5f-a827-86a7ae1ce7fc None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:15.538491 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f9a7f-70ff-4f5f-a827-86a7ae1ce7fc None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:15.538491 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f9a7f-70ff-4f5f-a827-86a7ae1ce7fc None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:15.539843 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 564/1131] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 16:22:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:15.545554 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82f6c8-62bc-4d8f-bb60-332a6e526acc None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:15.546053 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82f6c8-62bc-4d8f-bb60-332a6e526acc None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:15.546169 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82f6c8-62bc-4d8f-bb60-332a6e526acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:15.566820 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-1a82f6c8-62bc-4d8f-bb60-332a6e526acc None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:15.568085 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-1a82f6c8-62bc-4d8f-bb60-332a6e526acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:15.576095 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 568/1132] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 16:22:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:22:15.733455 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f9a7f-70ff-4f5f-a827-86a7ae1ce7fc None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:15.746723 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f9a7f-70ff-4f5f-a827-86a7ae1ce7fc None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:15.751881 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76caee32-a95b-46a3-ba99-2c268cf49ea8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:15.752470 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76caee32-a95b-46a3-ba99-2c268cf49ea8 service nova] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:15.752756 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76caee32-a95b-46a3-ba99-2c268cf49ea8 service nova] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:15.753123 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76caee32-a95b-46a3-ba99-2c268cf49ea8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:15.763802 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76caee32-a95b-46a3-ba99-2c268cf49ea8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:15.765435 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76caee32-a95b-46a3-ba99-2c268cf49ea8 service nova] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:15.776331 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 565/1133] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:22:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:22:19.964700 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d928825-076d-4550-8544-46c9390ef944 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:19.965221 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d928825-076d-4550-8544-46c9390ef944 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:19.965221 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d928825-076d-4550-8544-46c9390ef944 None None] PATH_INFO: `/v3` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:19.966475 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 569/1134] 10.222.0.69 () {54 vars in 925 bytes} [Wed Jul 27 16:22:19 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:19.972917 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc5326-432e-4e50-86d2-ddfd962c6aa1 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:19.973391 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc5326-432e-4e50-86d2-ddfd962c6aa1 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:19.973681 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc5326-432e-4e50-86d2-ddfd962c6aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:20.003046 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-98fc5326-432e-4e50-86d2-ddfd962c6aa1 None None] MFA Rules not processed for user `c311ccdc0d434bb6a9ef99da9a5404bf`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:20.004277 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-98fc5326-432e-4e50-86d2-ddfd962c6aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:20.058701 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:20.068040 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 566/1135] 10.222.0.69 () {58 vars in 1015 bytes} [Wed Jul 27 16:22:19 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:22:24.047306 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c79f3-4cb7-4818-bede-9d58d54ff402 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:24.047877 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c79f3-4cb7-4818-bede-9d58d54ff402 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:24.047983 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c79f3-4cb7-4818-bede-9d58d54ff402 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:24.049255 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 570/1136] 10.222.0.65 () {54 vars in 961 bytes} [Wed Jul 27 16:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:24.054589 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680cd41-3cf3-4f3a-89c4-6266d8ff03b1 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:24.055042 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680cd41-3cf3-4f3a-89c4-6266d8ff03b1 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:24.055134 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680cd41-3cf3-4f3a-89c4-6266d8ff03b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:24.074313 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-e680cd41-3cf3-4f3a-89c4-6266d8ff03b1 None None] MFA Rules not processed for user `c311ccdc0d434bb6a9ef99da9a5404bf`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:24.075524 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-e680cd41-3cf3-4f3a-89c4-6266d8ff03b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:24.083808 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 567/1137] 10.222.0.65 () {58 vars in 1058 bytes} [Wed Jul 27 16:22:24 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:22:24.091705 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c79f3-4cb7-4818-bede-9d58d54ff402 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:24.104939 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c79f3-4cb7-4818-bede-9d58d54ff402 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:24.109847 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63d712-26aa-485e-8e0c-943aaa7e851d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c311ccdc0d434bb6a9ef99da9a5404bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:24.110448 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63d712-26aa-485e-8e0c-943aaa7e851d service placement] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:24.110730 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63d712-26aa-485e-8e0c-943aaa7e851d service placement] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:24.111005 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63d712-26aa-485e-8e0c-943aaa7e851d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:24.119126 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63d712-26aa-485e-8e0c-943aaa7e851d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:24.120765 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63d712-26aa-485e-8e0c-943aaa7e851d service placement] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:24.130131 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 571/1138] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:22:24 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:22:27.037424 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd884e-1ec7-40bc-9d67-7cce509ee84d None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:27.037966 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd884e-1ec7-40bc-9d67-7cce509ee84d None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:27.037966 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd884e-1ec7-40bc-9d67-7cce509ee84d None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:27.039887 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 568/1139] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 16:22:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:27.044818 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cf3a7-fe9c-4e2b-8ca2-a91c06fbcf2a None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:27.045240 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cf3a7-fe9c-4e2b-8ca2-a91c06fbcf2a None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:27.045409 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cf3a7-fe9c-4e2b-8ca2-a91c06fbcf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:27.065034 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-682cf3a7-fe9c-4e2b-8ca2-a91c06fbcf2a None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:27.066221 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-682cf3a7-fe9c-4e2b-8ca2-a91c06fbcf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:27.074014 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 572/1140] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 16:22:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:22:27.237346 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd884e-1ec7-40bc-9d67-7cce509ee84d None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:27.251709 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd884e-1ec7-40bc-9d67-7cce509ee84d None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:27.262941 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83301cdc-29f8-42d0-8df8-5be4e5e25382 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:27.263608 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83301cdc-29f8-42d0-8df8-5be4e5e25382 service nova] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:27.263898 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83301cdc-29f8-42d0-8df8-5be4e5e25382 service nova] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:27.264178 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83301cdc-29f8-42d0-8df8-5be4e5e25382 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:27.273089 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83301cdc-29f8-42d0-8df8-5be4e5e25382 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:27.275164 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83301cdc-29f8-42d0-8df8-5be4e5e25382 service nova] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:27.285020 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 569/1141] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:22:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:22:28.106440 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f591ae-39c7-416d-a948-dad25c61aa77 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:28.107019 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f591ae-39c7-416d-a948-dad25c61aa77 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:28.107019 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f591ae-39c7-416d-a948-dad25c61aa77 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:28.108408 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 573/1142] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 16:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:28.113234 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffcb1a-a893-4ff6-a386-f7682e29a3c2 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:28.113646 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffcb1a-a893-4ff6-a386-f7682e29a3c2 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:28.113798 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffcb1a-a893-4ff6-a386-f7682e29a3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:28.134010 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-f8ffcb1a-a893-4ff6-a386-f7682e29a3c2 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:28.135193 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-f8ffcb1a-a893-4ff6-a386-f7682e29a3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:28.143107 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 570/1143] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 16:22:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:22:28.298366 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f591ae-39c7-416d-a948-dad25c61aa77 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:28.312356 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f591ae-39c7-416d-a948-dad25c61aa77 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:28.317200 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5eb1e-9bb1-4193-8ec4-16b13d89da55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:28.317805 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5eb1e-9bb1-4193-8ec4-16b13d89da55 service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:28.318085 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5eb1e-9bb1-4193-8ec4-16b13d89da55 service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:28.318363 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5eb1e-9bb1-4193-8ec4-16b13d89da55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:28.327325 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5eb1e-9bb1-4193-8ec4-16b13d89da55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:28.328970 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5eb1e-9bb1-4193-8ec4-16b13d89da55 service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:28.338322 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 574/1144] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:22:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:22:32.580783 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9333b7-e90e-4baa-b3bd-885d7915c035 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:32.581380 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9333b7-e90e-4baa-b3bd-885d7915c035 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:32.581380 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9333b7-e90e-4baa-b3bd-885d7915c035 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:32.582697 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 571/1145] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 16:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:32.588455 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2981a-87cc-4208-9dd0-9a1dae511a48 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:32.588926 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2981a-87cc-4208-9dd0-9a1dae511a48 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:32.589045 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2981a-87cc-4208-9dd0-9a1dae511a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:32.608655 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-a1d2981a-87cc-4208-9dd0-9a1dae511a48 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:32.609838 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-a1d2981a-87cc-4208-9dd0-9a1dae511a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:32.617576 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 575/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 16:22:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:22:32.655400 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9333b7-e90e-4baa-b3bd-885d7915c035 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:32.657124 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-4c9333b7-e90e-4baa-b3bd-885d7915c035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:32.718491 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9333b7-e90e-4baa-b3bd-885d7915c035 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:32.721939 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f8bc7-c989-489f-a6ef-0cbc44955a83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:32.722553 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f8bc7-c989-489f-a6ef-0cbc44955a83 service neutron] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:32.722837 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f8bc7-c989-489f-a6ef-0cbc44955a83 service neutron] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:32.723117 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f8bc7-c989-489f-a6ef-0cbc44955a83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:32.735699 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f8bc7-c989-489f-a6ef-0cbc44955a83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:32.737149 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f8bc7-c989-489f-a6ef-0cbc44955a83 service neutron] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:32.747199 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 572/1147] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:22:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:22:34.975215 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b856306-cab1-401a-8070-3b8d4d6b5ef7 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:34.975774 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b856306-cab1-401a-8070-3b8d4d6b5ef7 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:34.975774 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b856306-cab1-401a-8070-3b8d4d6b5ef7 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:34.977725 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 576/1148] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 16:22:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:34.982981 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480eef2-e91f-4d77-857c-5918649ec79f None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:34.983457 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480eef2-e91f-4d77-857c-5918649ec79f None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:34.983574 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480eef2-e91f-4d77-857c-5918649ec79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:35.002633 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-9480eef2-e91f-4d77-857c-5918649ec79f None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:35.003871 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-9480eef2-e91f-4d77-857c-5918649ec79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:35.011656 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 573/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 16:22:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:22:35.049926 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b856306-cab1-401a-8070-3b8d4d6b5ef7 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:35.051745 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-3b856306-cab1-401a-8070-3b8d4d6b5ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:35.059393 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=61 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:35.065587 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b856306-cab1-401a-8070-3b8d4d6b5ef7 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:35.069037 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1248a-c9f0-46dd-b0ce-288924c01fcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:35.069643 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1248a-c9f0-46dd-b0ce-288924c01fcc service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:35.069922 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1248a-c9f0-46dd-b0ce-288924c01fcc service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:35.070195 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1248a-c9f0-46dd-b0ce-288924c01fcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:35.078935 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1248a-c9f0-46dd-b0ce-288924c01fcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:35.080389 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1248a-c9f0-46dd-b0ce-288924c01fcc service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:35.089971 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 577/1150] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:22:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:22:39.016711 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25df67-a4e3-4d4c-bcb7-dae4d9d5eceb None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:39.017324 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25df67-a4e3-4d4c-bcb7-dae4d9d5eceb None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:39.017324 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25df67-a4e3-4d4c-bcb7-dae4d9d5eceb None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:39.018534 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 574/1151] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 16:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:39.023801 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251ab05-3c05-4921-b989-00056386e850 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:39.024264 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251ab05-3c05-4921-b989-00056386e850 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:39.024364 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251ab05-3c05-4921-b989-00056386e850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:39.044282 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-b251ab05-3c05-4921-b989-00056386e850 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:39.045493 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-b251ab05-3c05-4921-b989-00056386e850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:39.053375 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 578/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 16:22:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:22:39.327913 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25df67-a4e3-4d4c-bcb7-dae4d9d5eceb None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:39.329568 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-3c25df67-a4e3-4d4c-bcb7-dae4d9d5eceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:39.387393 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25df67-a4e3-4d4c-bcb7-dae4d9d5eceb None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:39.390913 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a651a8-5505-4edb-b8d5-c817b6c589de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6d1f7acba3415f84c2f01b66190b8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:39.391556 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a651a8-5505-4edb-b8d5-c817b6c589de service cinder] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:39.391840 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a651a8-5505-4edb-b8d5-c817b6c589de service cinder] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:39.392114 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a651a8-5505-4edb-b8d5-c817b6c589de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:39.401776 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a651a8-5505-4edb-b8d5-c817b6c589de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:39.403194 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a651a8-5505-4edb-b8d5-c817b6c589de service cinder] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:39.412781 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 575/1153] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:22:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:22:41.674638 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59f6d8-7080-4093-8b18-cc4df8adce07 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:41.675064 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59f6d8-7080-4093-8b18-cc4df8adce07 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:41.675165 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59f6d8-7080-4093-8b18-cc4df8adce07 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:41.676529 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 579/1154] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 16:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:41.681854 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dd158-53ec-4b00-9fb7-3ffa10c02e16 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:41.682259 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dd158-53ec-4b00-9fb7-3ffa10c02e16 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:41.682414 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dd158-53ec-4b00-9fb7-3ffa10c02e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:41.701603 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-2e6dd158-53ec-4b00-9fb7-3ffa10c02e16 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:41.702791 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-2e6dd158-53ec-4b00-9fb7-3ffa10c02e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:41.710559 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 576/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 16:22:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:22:41.985201 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59f6d8-7080-4093-8b18-cc4df8adce07 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:41.986850 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-7e59f6d8-7080-4093-8b18-cc4df8adce07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:41.999643 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59f6d8-7080-4093-8b18-cc4df8adce07 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:42.003209 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1983e404-9ae3-40cd-8c02-a0ff014b2962 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6d1f7acba3415f84c2f01b66190b8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:42.003861 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983e404-9ae3-40cd-8c02-a0ff014b2962 service cinder] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:42.004144 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983e404-9ae3-40cd-8c02-a0ff014b2962 service cinder] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:42.004420 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983e404-9ae3-40cd-8c02-a0ff014b2962 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:42.013963 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1983e404-9ae3-40cd-8c02-a0ff014b2962 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:42.015400 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1983e404-9ae3-40cd-8c02-a0ff014b2962 service cinder] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:42.025061 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 580/1156] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:22:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:22:51.696513 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=70 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:52.020577 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=14 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:01.831234 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb57fe-b8f0-4411-b3c2-22aa1e16c781 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:01.831914 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb57fe-b8f0-4411-b3c2-22aa1e16c781 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:01.831914 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb57fe-b8f0-4411-b3c2-22aa1e16c781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:01.835187 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668cec6-533a-4fb9-9fba-1131ac440c76 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:01.835677 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668cec6-533a-4fb9-9fba-1131ac440c76 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:01.835826 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668cec6-533a-4fb9-9fba-1131ac440c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:01.851305 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-8cbb57fe-b8f0-4411-b3c2-22aa1e16c781 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:24:01.854612 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-0668cec6-533a-4fb9-9fba-1131ac440c76 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:24:01.858895 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-0668cec6-533a-4fb9-9fba-1131ac440c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:01.859056 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-8cbb57fe-b8f0-4411-b3c2-22aa1e16c781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:01.866766 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 581/1157] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 16:24:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:24:01.867071 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 577/1158] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 16:24:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:24:01.875809 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471af21-f546-409a-9421-300c602757d8 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:01.875980 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17046d22-a78f-444d-bb1b-0e66da77bb18 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:01.876095 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471af21-f546-409a-9421-300c602757d8 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:01.876197 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17046d22-a78f-444d-bb1b-0e66da77bb18 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:01.876355 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471af21-f546-409a-9421-300c602757d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:01.876470 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17046d22-a78f-444d-bb1b-0e66da77bb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:01.896272 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-c471af21-f546-409a-9421-300c602757d8 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:24:01.896515 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-17046d22-a78f-444d-bb1b-0e66da77bb18 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:24:01.897474 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-c471af21-f546-409a-9421-300c602757d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:01.897587 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-17046d22-a78f-444d-bb1b-0e66da77bb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:01.906457 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 582/1159] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 16:24:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:24:01.907308 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 578/1160] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 16:24:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:24:01.910977 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17046d22-a78f-444d-bb1b-0e66da77bb18 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:01.911752 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471af21-f546-409a-9421-300c602757d8 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:01.920694 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17046d22-a78f-444d-bb1b-0e66da77bb18 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:01.920849 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471af21-f546-409a-9421-300c602757d8 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:01.925223 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe22ca-a494-4bc0-ba21-1a961df4b2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:01.925376 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167ba7e-7c42-4cdb-abd4-c209982b81a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:01.925836 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe22ca-a494-4bc0-ba21-1a961df4b2ca admin admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:01.925964 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167ba7e-7c42-4cdb-abd4-c209982b81a8 admin admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:01.926125 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe22ca-a494-4bc0-ba21-1a961df4b2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:01.926243 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167ba7e-7c42-4cdb-abd4-c209982b81a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:01.926393 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167ba7e-7c42-4cdb-abd4-c209982b81a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:01.926491 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe22ca-a494-4bc0-ba21-1a961df4b2ca admin admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:01.927075 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167ba7e-7c42-4cdb-abd4-c209982b81a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:01.927185 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe22ca-a494-4bc0-ba21-1a961df4b2ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:01.927402 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167ba7e-7c42-4cdb-abd4-c209982b81a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:01.927516 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe22ca-a494-4bc0-ba21-1a961df4b2ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:01.928452 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: WARNING py.warnings [None req-7dfe22ca-a494-4bc0-ba21-1a961df4b2ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:24:01.928452 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: warnings.warn(msg) Jul 27 16:24:01.928452 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: Jul 27 16:24:01.929146 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167ba7e-7c42-4cdb-abd4-c209982b81a8 admin admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:01.929420 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe22ca-a494-4bc0-ba21-1a961df4b2ca admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:01.941407 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 579/1161] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 16:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:24:01.941560 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 583/1162] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 16:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:01.950053 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167ba7e-7c42-4cdb-abd4-c209982b81a8 admin admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:01.950208 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe22ca-a494-4bc0-ba21-1a961df4b2ca admin admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:01.960004 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167ba7e-7c42-4cdb-abd4-c209982b81a8 admin admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:01.960256 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe22ca-a494-4bc0-ba21-1a961df4b2ca admin admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:01.964542 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273c406-62a6-4b96-add3-e63a1ac9527c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:01.964693 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a393494-2dfb-4d3a-be6d-c9a5d7a7e7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:01.965149 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273c406-62a6-4b96-add3-e63a1ac9527c admin admin] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:01.965261 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a393494-2dfb-4d3a-be6d-c9a5d7a7e7a4 admin admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:01.965431 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a393494-2dfb-4d3a-be6d-c9a5d7a7e7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:01.965530 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273c406-62a6-4b96-add3-e63a1ac9527c admin admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:01.965706 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273c406-62a6-4b96-add3-e63a1ac9527c admin admin] PATH_INFO: `/v3/projects` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:01.965798 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a393494-2dfb-4d3a-be6d-c9a5d7a7e7a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:01.966366 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a393494-2dfb-4d3a-be6d-c9a5d7a7e7a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:01.966479 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273c406-62a6-4b96-add3-e63a1ac9527c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:01.967403 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: WARNING py.warnings [None req-6273c406-62a6-4b96-add3-e63a1ac9527c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:24:01.967403 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: warnings.warn(msg) Jul 27 16:24:01.967403 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: Jul 27 16:24:01.968326 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a393494-2dfb-4d3a-be6d-c9a5d7a7e7a4 admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:01.968591 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273c406-62a6-4b96-add3-e63a1ac9527c admin admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:02.007788 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 580/1163] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 16:24:01 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:24:02.014325 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 584/1164] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 16:24:01 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:24:02.014474 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273c406-62a6-4b96-add3-e63a1ac9527c admin admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:02.015626 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a393494-2dfb-4d3a-be6d-c9a5d7a7e7a4 admin admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:02.076345 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273c406-62a6-4b96-add3-e63a1ac9527c admin admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:02.079559 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a393494-2dfb-4d3a-be6d-c9a5d7a7e7a4 admin admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:02.081011 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526193dc-73b6-4fb3-a11c-422fbd674998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:02.081628 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526193dc-73b6-4fb3-a11c-422fbd674998 admin admin] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:02.081911 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526193dc-73b6-4fb3-a11c-422fbd674998 admin admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:02.082188 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526193dc-73b6-4fb3-a11c-422fbd674998 admin admin] PATH_INFO: `/v3/users` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:02.082852 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526193dc-73b6-4fb3-a11c-422fbd674998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:02.084253 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f534f-2614-4eb4-9224-e20ef9e4ff39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:02.084788 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526193dc-73b6-4fb3-a11c-422fbd674998 admin admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:02.084898 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f534f-2614-4eb4-9224-e20ef9e4ff39 admin admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:02.085176 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f534f-2614-4eb4-9224-e20ef9e4ff39 admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:02.085459 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f534f-2614-4eb4-9224-e20ef9e4ff39 admin admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:02.086120 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f534f-2614-4eb4-9224-e20ef9e4ff39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:02.087783 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: WARNING py.warnings [None req-568f534f-2614-4eb4-9224-e20ef9e4ff39 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:24:02.087783 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: warnings.warn(msg) Jul 27 16:24:02.087783 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: Jul 27 16:24:02.089040 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f534f-2614-4eb4-9224-e20ef9e4ff39 admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:02.107876 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 581/1165] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 16:24:02 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:24:02.111906 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526193dc-73b6-4fb3-a11c-422fbd674998 admin admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:02.116002 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 585/1166] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 16:24:02 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:24:02.117211 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f534f-2614-4eb4-9224-e20ef9e4ff39 admin admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:02.121665 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526193dc-73b6-4fb3-a11c-422fbd674998 admin admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:02.126407 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ff14e-5733-457e-b97d-e764cdba9bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:02.126844 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f534f-2614-4eb4-9224-e20ef9e4ff39 admin admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:02.127019 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ff14e-5733-457e-b97d-e764cdba9bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:02.127309 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ff14e-5733-457e-b97d-e764cdba9bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:02.127619 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ff14e-5733-457e-b97d-e764cdba9bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:02.128305 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ff14e-5733-457e-b97d-e764cdba9bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:02.129904 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ff14e-5733-457e-b97d-e764cdba9bf0 admin admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:02.131720 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd667c8-f897-41ea-9112-510561154d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:02.132322 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd667c8-f897-41ea-9112-510561154d4a admin admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:02.132605 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd667c8-f897-41ea-9112-510561154d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:02.132880 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd667c8-f897-41ea-9112-510561154d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:02.133572 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd667c8-f897-41ea-9112-510561154d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:02.135686 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd667c8-f897-41ea-9112-510561154d4a admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:02.144657 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 582/1167] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 16:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:24:02.153229 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 586/1168] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 16:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:24:02.153440 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ff14e-5733-457e-b97d-e764cdba9bf0 admin admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:02.154545 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd667c8-f897-41ea-9112-510561154d4a admin admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:02.159853 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ff14e-5733-457e-b97d-e764cdba9bf0 admin admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:02.164461 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd667c8-f897-41ea-9112-510561154d4a admin admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:02.164612 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7f36f-9b37-4b38-9a0b-23fb2a5a7566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:02.165140 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7f36f-9b37-4b38-9a0b-23fb2a5a7566 admin admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:02.165490 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7f36f-9b37-4b38-9a0b-23fb2a5a7566 admin admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:02.165738 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7f36f-9b37-4b38-9a0b-23fb2a5a7566 admin admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:02.166435 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7f36f-9b37-4b38-9a0b-23fb2a5a7566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:02.168101 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7f36f-9b37-4b38-9a0b-23fb2a5a7566 admin admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:02.169454 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a045c4c-a1dd-453d-82e7-7ad34d8443da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:02.170075 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a045c4c-a1dd-453d-82e7-7ad34d8443da admin admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:02.170365 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a045c4c-a1dd-453d-82e7-7ad34d8443da admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:02.170641 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a045c4c-a1dd-453d-82e7-7ad34d8443da admin admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:02.171415 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a045c4c-a1dd-453d-82e7-7ad34d8443da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:02.173062 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a045c4c-a1dd-453d-82e7-7ad34d8443da admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:02.179473 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 583/1169] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 16:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:24:02.184652 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7f36f-9b37-4b38-9a0b-23fb2a5a7566 admin admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:02.186641 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 587/1170] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 16:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:24:02.190601 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a045c4c-a1dd-453d-82e7-7ad34d8443da admin admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:02.194899 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7f36f-9b37-4b38-9a0b-23fb2a5a7566 admin admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:02.200229 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e606e1-4e9a-4a92-ba8f-882e47e8122c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:02.200951 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e606e1-4e9a-4a92-ba8f-882e47e8122c admin admin] REQUEST_METHOD: `PUT` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:02.201074 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a045c4c-a1dd-453d-82e7-7ad34d8443da admin admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:02.201236 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e606e1-4e9a-4a92-ba8f-882e47e8122c admin admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:02.201511 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e606e1-4e9a-4a92-ba8f-882e47e8122c admin admin] PATH_INFO: `/v3/projects/e2b9ab3c8926480a82662503de2a51c8/users/57c1a8c5c03b41f29a671b68bb64b403/roles/5698bc4d332140e9af77ddcbb9915736` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:02.206427 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a1c0d-c449-464b-8e53-8dbfc69a384a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:02.207089 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a1c0d-c449-464b-8e53-8dbfc69a384a admin admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:02.207397 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a1c0d-c449-464b-8e53-8dbfc69a384a admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:02.207689 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a1c0d-c449-464b-8e53-8dbfc69a384a admin admin] PATH_INFO: `/v3/projects/5e6ff3c0fcc448dc880516ef28f8bc7c/users/04cc20b616664af287ba2cd3c314cb49/roles/5698bc4d332140e9af77ddcbb9915736` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:02.217693 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e606e1-4e9a-4a92-ba8f-882e47e8122c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b9ab3c8926480a82662503de2a51c8, user_id=57c1a8c5c03b41f29a671b68bb64b403, role_id=5698bc4d332140e9af77ddcbb9915736)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:02.218786 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: WARNING py.warnings [None req-25e606e1-4e9a-4a92-ba8f-882e47e8122c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:24:02.218786 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: warnings.warn(msg) Jul 27 16:24:02.218786 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: Jul 27 16:24:02.220785 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e606e1-4e9a-4a92-ba8f-882e47e8122c admin admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:02.222988 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a1c0d-c449-464b-8e53-8dbfc69a384a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e6ff3c0fcc448dc880516ef28f8bc7c, user_id=04cc20b616664af287ba2cd3c314cb49, role_id=5698bc4d332140e9af77ddcbb9915736)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:02.225716 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a1c0d-c449-464b-8e53-8dbfc69a384a admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:02.236742 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 584/1171] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 16:24:02 2022] PUT /identity/v3/projects/e2b9ab3c8926480a82662503de2a51c8/users/57c1a8c5c03b41f29a671b68bb64b403/roles/5698bc4d332140e9af77ddcbb9915736 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:24:02.243466 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030d4a1-503c-4143-a56f-04881bb6a3aa None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:02.243789 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030d4a1-503c-4143-a56f-04881bb6a3aa None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:02.244086 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030d4a1-503c-4143-a56f-04881bb6a3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:02.244633 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 588/1172] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 16:24:02 2022] PUT /identity/v3/projects/5e6ff3c0fcc448dc880516ef28f8bc7c/users/04cc20b616664af287ba2cd3c314cb49/roles/5698bc4d332140e9af77ddcbb9915736 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:24:02.249531 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dfa5a-0222-48c7-b9af-fa5674cf5c65 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:02.249827 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dfa5a-0222-48c7-b9af-fa5674cf5c65 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:02.250115 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dfa5a-0222-48c7-b9af-fa5674cf5c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:02.264049 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-3030d4a1-503c-4143-a56f-04881bb6a3aa None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:24:02.265596 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-3030d4a1-503c-4143-a56f-04881bb6a3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:02.276660 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-b32dfa5a-0222-48c7-b9af-fa5674cf5c65 None None] MFA Rules not processed for user `30d80e0d318d4f78a4aac8c796957981`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:24:02.280518 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-b32dfa5a-0222-48c7-b9af-fa5674cf5c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:02.312526 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:02.332776 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:02.332989 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 585/1173] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 16:24:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:24:02.344333 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030d4a1-503c-4143-a56f-04881bb6a3aa None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:02.352603 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 589/1174] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 16:24:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:24:02.362595 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32dfa5a-0222-48c7-b9af-fa5674cf5c65 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:02.400607 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030d4a1-503c-4143-a56f-04881bb6a3aa None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:02.404912 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b0824-fa0c-4f31-8d5b-6afd213393ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:02.405535 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b0824-fa0c-4f31-8d5b-6afd213393ea service neutron] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:02.405827 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b0824-fa0c-4f31-8d5b-6afd213393ea service neutron] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:02.406108 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b0824-fa0c-4f31-8d5b-6afd213393ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:02.415333 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b0824-fa0c-4f31-8d5b-6afd213393ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:02.416798 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b0824-fa0c-4f31-8d5b-6afd213393ea service neutron] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:02.418191 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32dfa5a-0222-48c7-b9af-fa5674cf5c65 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:02.421922 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8b754-d40a-4f42-abac-c4cc5e96ea9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:02.422485 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8b754-d40a-4f42-abac-c4cc5e96ea9c service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:02.422771 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8b754-d40a-4f42-abac-c4cc5e96ea9c service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:02.423053 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8b754-d40a-4f42-abac-c4cc5e96ea9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:02.426239 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 586/1175] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:24:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:24:02.433257 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8b754-d40a-4f42-abac-c4cc5e96ea9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:02.434721 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8b754-d40a-4f42-abac-c4cc5e96ea9c service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:02.444522 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 590/1176] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:24:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:24:07.750385 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80e68d-f6e2-47bb-a557-cfde5048d6d6 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:07.750979 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80e68d-f6e2-47bb-a557-cfde5048d6d6 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:07.750979 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80e68d-f6e2-47bb-a557-cfde5048d6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:07.802944 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-1c80e68d-f6e2-47bb-a557-cfde5048d6d6 None None] MFA Rules not processed for user `04cc20b616664af287ba2cd3c314cb49`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:24:07.804248 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-1c80e68d-f6e2-47bb-a557-cfde5048d6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:07.930214 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 587/1177] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 16:24:07 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:24:07.933774 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8b754-d40a-4f42-abac-c4cc5e96ea9c service neutron] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:07.956495 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8b754-d40a-4f42-abac-c4cc5e96ea9c service neutron] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:07.965317 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9a128-b910-45ac-91fd-67424dc1939e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:07.965962 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9a128-b910-45ac-91fd-67424dc1939e admin admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:07.966250 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9a128-b910-45ac-91fd-67424dc1939e admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:07.966532 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9a128-b910-45ac-91fd-67424dc1939e admin admin] PATH_INFO: `/v3/projects` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:07.967218 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9a128-b910-45ac-91fd-67424dc1939e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:07.969328 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9a128-b910-45ac-91fd-67424dc1939e admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:08.008662 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 591/1178] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 16:24:07 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:24:08.012780 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80e68d-f6e2-47bb-a557-cfde5048d6d6 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:08.027572 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80e68d-f6e2-47bb-a557-cfde5048d6d6 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:08.110933 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d3b47-28f3-4ef1-859f-2d1c9a47f980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:08.113389 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d3b47-28f3-4ef1-859f-2d1c9a47f980 admin admin] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:08.113707 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d3b47-28f3-4ef1-859f-2d1c9a47f980 admin admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:08.113988 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d3b47-28f3-4ef1-859f-2d1c9a47f980 admin admin] PATH_INFO: `/v3/users` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:08.114718 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d3b47-28f3-4ef1-859f-2d1c9a47f980 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:08.116739 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d3b47-28f3-4ef1-859f-2d1c9a47f980 admin admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:08.138484 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea871d9b-43cc-44c3-b75f-038bd9219775 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:08.139020 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea871d9b-43cc-44c3-b75f-038bd9219775 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:08.139297 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea871d9b-43cc-44c3-b75f-038bd9219775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:08.151200 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 588/1179] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 16:24:08 2022] POST /identity/v3/users => generated 298 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:24:08.155184 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d3b47-28f3-4ef1-859f-2d1c9a47f980 admin admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:08.165197 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d3b47-28f3-4ef1-859f-2d1c9a47f980 admin admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:08.170182 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c517801-1f61-4801-ab22-4dd8709cf76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:08.170909 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c517801-1f61-4801-ab22-4dd8709cf76c admin admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:08.171310 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c517801-1f61-4801-ab22-4dd8709cf76c admin admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:08.171752 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c517801-1f61-4801-ab22-4dd8709cf76c admin admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:08.172713 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c517801-1f61-4801-ab22-4dd8709cf76c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:08.174420 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c517801-1f61-4801-ab22-4dd8709cf76c admin admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:08.176898 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:08.180542 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-ea871d9b-43cc-44c3-b75f-038bd9219775 None None] MFA Rules not processed for user `57c1a8c5c03b41f29a671b68bb64b403`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:24:08.182300 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-ea871d9b-43cc-44c3-b75f-038bd9219775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:08.190841 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 589/1180] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 16:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:24:08.191758 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c517801-1f61-4801-ab22-4dd8709cf76c admin admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:08.203012 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c517801-1f61-4801-ab22-4dd8709cf76c admin admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:08.208460 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb13b7-2a99-436f-b136-eaf5bb9b6832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:08.209213 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb13b7-2a99-436f-b136-eaf5bb9b6832 admin admin] REQUEST_METHOD: `PUT` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:08.209564 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb13b7-2a99-436f-b136-eaf5bb9b6832 admin admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:08.209850 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb13b7-2a99-436f-b136-eaf5bb9b6832 admin admin] PATH_INFO: `/v3/projects/20f30a1d662641a3b7323af0249aa89f/users/f7f2a7472a3c4dadb251a8e7b78ca08b/roles/76e01abae9964dd5b28fc8895f739ee4` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:08.228603 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb13b7-2a99-436f-b136-eaf5bb9b6832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20f30a1d662641a3b7323af0249aa89f, user_id=f7f2a7472a3c4dadb251a8e7b78ca08b, role_id=76e01abae9964dd5b28fc8895f739ee4)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:08.231502 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb13b7-2a99-436f-b136-eaf5bb9b6832 admin admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:08.252220 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 590/1181] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 16:24:08 2022] PUT /identity/v3/projects/20f30a1d662641a3b7323af0249aa89f/users/f7f2a7472a3c4dadb251a8e7b78ca08b/roles/76e01abae9964dd5b28fc8895f739ee4 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:24:08.253904 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb13b7-2a99-436f-b136-eaf5bb9b6832 admin admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:08.267564 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 592/1182] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 16:24:08 2022] POST /identity/v3/auth/tokens => generated 2802 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:24:08.268511 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea871d9b-43cc-44c3-b75f-038bd9219775 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:08.281395 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea871d9b-43cc-44c3-b75f-038bd9219775 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:08.332496 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb13b7-2a99-436f-b136-eaf5bb9b6832 admin admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:08.338451 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6843bf-ae10-4ad5-808e-2a3757452f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:08.339081 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6843bf-ae10-4ad5-808e-2a3757452f0e admin admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:08.339364 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6843bf-ae10-4ad5-808e-2a3757452f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:08.339666 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6843bf-ae10-4ad5-808e-2a3757452f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:08.340512 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6843bf-ae10-4ad5-808e-2a3757452f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:08.342123 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6843bf-ae10-4ad5-808e-2a3757452f0e admin admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:08.344471 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:08.353499 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f6032-9953-49d6-b28e-77013dab43df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:08.354148 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f6032-9953-49d6-b28e-77013dab43df admin admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:08.354442 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f6032-9953-49d6-b28e-77013dab43df admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:08.354787 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f6032-9953-49d6-b28e-77013dab43df admin admin] PATH_INFO: `/v3/projects` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:08.355418 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8f6032-9953-49d6-b28e-77013dab43df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:08.357474 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8f6032-9953-49d6-b28e-77013dab43df admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:08.361749 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 591/1183] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 16:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:24:08.362754 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6843bf-ae10-4ad5-808e-2a3757452f0e admin admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:08.374307 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6843bf-ae10-4ad5-808e-2a3757452f0e admin admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:08.380487 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbebf52-7663-43e8-af62-3f3b61d234a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:08.381333 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbebf52-7663-43e8-af62-3f3b61d234a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:08.381801 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbebf52-7663-43e8-af62-3f3b61d234a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:08.382225 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbebf52-7663-43e8-af62-3f3b61d234a8 admin admin] PATH_INFO: `/v3/projects/20f30a1d662641a3b7323af0249aa89f/users/f7f2a7472a3c4dadb251a8e7b78ca08b/roles/76e01abae9964dd5b28fc8895f739ee4` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:08.384387 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbebf52-7663-43e8-af62-3f3b61d234a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20f30a1d662641a3b7323af0249aa89f, user_id=f7f2a7472a3c4dadb251a8e7b78ca08b, role_id=76e01abae9964dd5b28fc8895f739ee4)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:08.387347 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbebf52-7663-43e8-af62-3f3b61d234a8 admin admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:08.395694 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 593/1184] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 16:24:08 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:24:08.396760 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f6032-9953-49d6-b28e-77013dab43df admin admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:08.403274 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 592/1185] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 16:24:08 2022] PUT /identity/v3/projects/20f30a1d662641a3b7323af0249aa89f/users/f7f2a7472a3c4dadb251a8e7b78ca08b/roles/76e01abae9964dd5b28fc8895f739ee4 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:24:08.481242 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f6032-9953-49d6-b28e-77013dab43df admin admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:08.570336 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ebea6-3644-4e3e-8d30-6272c534e223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:08.571797 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ebea6-3644-4e3e-8d30-6272c534e223 admin admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:08.572175 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ebea6-3644-4e3e-8d30-6272c534e223 admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:08.572567 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ebea6-3644-4e3e-8d30-6272c534e223 admin admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:08.573343 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ebea6-3644-4e3e-8d30-6272c534e223 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:08.575574 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ebea6-3644-4e3e-8d30-6272c534e223 admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:08.608312 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 594/1186] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 16:24:08 2022] POST /identity/v3/users => generated 296 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:24:08.609866 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbebf52-7663-43e8-af62-3f3b61d234a8 admin admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:08.631128 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbebf52-7663-43e8-af62-3f3b61d234a8 admin admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:08.653083 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229001a-00c0-4973-bfe5-4199ffa96e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:08.654255 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229001a-00c0-4973-bfe5-4199ffa96e3b admin admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:08.655021 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229001a-00c0-4973-bfe5-4199ffa96e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:08.655021 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229001a-00c0-4973-bfe5-4199ffa96e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:08.655994 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c229001a-00c0-4973-bfe5-4199ffa96e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:08.658232 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c229001a-00c0-4973-bfe5-4199ffa96e3b admin admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:08.673213 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 593/1187] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 16:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:24:08.677589 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ebea6-3644-4e3e-8d30-6272c534e223 admin admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:08.695302 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ebea6-3644-4e3e-8d30-6272c534e223 admin admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:08.702703 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95110c41-3bed-48ac-b760-f8329bce6d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:08.703498 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95110c41-3bed-48ac-b760-f8329bce6d15 admin admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:08.703813 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95110c41-3bed-48ac-b760-f8329bce6d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:08.704099 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95110c41-3bed-48ac-b760-f8329bce6d15 admin admin] PATH_INFO: `/v3/projects/fafb22d0bdc84b69bda971069fb49950/users/67e521bd96c24057b4b5dfadbb3ab03e/roles/76e01abae9964dd5b28fc8895f739ee4` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:08.727969 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95110c41-3bed-48ac-b760-f8329bce6d15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fafb22d0bdc84b69bda971069fb49950, user_id=67e521bd96c24057b4b5dfadbb3ab03e, role_id=76e01abae9964dd5b28fc8895f739ee4)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:08.730759 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95110c41-3bed-48ac-b760-f8329bce6d15 admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:08.753654 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229001a-00c0-4973-bfe5-4199ffa96e3b admin admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:08.754204 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 595/1188] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 16:24:08 2022] PUT /identity/v3/projects/fafb22d0bdc84b69bda971069fb49950/users/67e521bd96c24057b4b5dfadbb3ab03e/roles/76e01abae9964dd5b28fc8895f739ee4 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:24:08.765904 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229001a-00c0-4973-bfe5-4199ffa96e3b admin admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:08.870847 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a023683-3347-4541-984b-ee673e0e35af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:08.871685 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a023683-3347-4541-984b-ee673e0e35af admin admin] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:08.872066 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a023683-3347-4541-984b-ee673e0e35af admin admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:08.872442 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a023683-3347-4541-984b-ee673e0e35af admin admin] PATH_INFO: `/v3/roles` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:08.873238 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a023683-3347-4541-984b-ee673e0e35af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:08.875118 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a023683-3347-4541-984b-ee673e0e35af admin admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:08.899110 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95110c41-3bed-48ac-b760-f8329bce6d15 admin admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:08.900501 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 594/1189] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 16:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:24:08.913516 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95110c41-3bed-48ac-b760-f8329bce6d15 admin admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:08.919693 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd5de4-0e0c-46ae-95f2-e50818f3fb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:08.920773 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd5de4-0e0c-46ae-95f2-e50818f3fb4c admin admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:08.921067 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd5de4-0e0c-46ae-95f2-e50818f3fb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:08.921349 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd5de4-0e0c-46ae-95f2-e50818f3fb4c admin admin] PATH_INFO: `/v3/projects/fafb22d0bdc84b69bda971069fb49950/users/67e521bd96c24057b4b5dfadbb3ab03e/roles/76e01abae9964dd5b28fc8895f739ee4` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:08.923423 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd5de4-0e0c-46ae-95f2-e50818f3fb4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fafb22d0bdc84b69bda971069fb49950, user_id=67e521bd96c24057b4b5dfadbb3ab03e, role_id=76e01abae9964dd5b28fc8895f739ee4)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:08.927156 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd5de4-0e0c-46ae-95f2-e50818f3fb4c admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:08.944838 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 596/1190] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 16:24:08 2022] PUT /identity/v3/projects/fafb22d0bdc84b69bda971069fb49950/users/67e521bd96c24057b4b5dfadbb3ab03e/roles/76e01abae9964dd5b28fc8895f739ee4 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:24:14.832688 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547224b-cad6-49cc-a1d6-4aaa8389579e None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:14.833234 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547224b-cad6-49cc-a1d6-4aaa8389579e None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:14.833234 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547224b-cad6-49cc-a1d6-4aaa8389579e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:14.909849 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-2547224b-cad6-49cc-a1d6-4aaa8389579e None None] MFA Rules not processed for user `f7f2a7472a3c4dadb251a8e7b78ca08b`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:24:14.911391 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-2547224b-cad6-49cc-a1d6-4aaa8389579e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:14.969694 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:15.063236 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 595/1191] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 16:24:14 2022] POST /identity/v3/auth/tokens => generated 2877 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:24:15.082001 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd5de4-0e0c-46ae-95f2-e50818f3fb4c admin admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:15.084300 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-37cd5de4-0e0c-46ae-95f2-e50818f3fb4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:15.173616 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:15.208681 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd5de4-0e0c-46ae-95f2-e50818f3fb4c admin admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:15.217092 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead16a73-5dfb-4e0f-aece-f0225b311e57 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43377fb5ab3c4ddfb54b3b2cae8eb351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:15.217771 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead16a73-5dfb-4e0f-aece-f0225b311e57 service glance] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:15.218145 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead16a73-5dfb-4e0f-aece-f0225b311e57 service glance] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:15.218429 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead16a73-5dfb-4e0f-aece-f0225b311e57 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:15.302415 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead16a73-5dfb-4e0f-aece-f0225b311e57 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:15.304113 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead16a73-5dfb-4e0f-aece-f0225b311e57 service glance] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:15.316039 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 597/1192] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:24:15 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:24:15.517428 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3833b1d-f1d4-4fb9-bf73-c27ccdc5c0ae None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:15.517762 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3833b1d-f1d4-4fb9-bf73-c27ccdc5c0ae None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:15.517997 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3833b1d-f1d4-4fb9-bf73-c27ccdc5c0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:15.569435 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-d3833b1d-f1d4-4fb9-bf73-c27ccdc5c0ae None None] MFA Rules not processed for user `67e521bd96c24057b4b5dfadbb3ab03e`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:24:15.576009 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-d3833b1d-f1d4-4fb9-bf73-c27ccdc5c0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:15.704620 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 596/1193] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 16:24:15 2022] POST /identity/v3/auth/tokens => generated 2873 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:24:15.715902 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead16a73-5dfb-4e0f-aece-f0225b311e57 service glance] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:15.726619 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead16a73-5dfb-4e0f-aece-f0225b311e57 service glance] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:15.739358 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f189c5-bfdc-4de3-ba83-84cb455f2bef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43377fb5ab3c4ddfb54b3b2cae8eb351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:15.740197 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f189c5-bfdc-4de3-ba83-84cb455f2bef service glance] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:15.740721 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f189c5-bfdc-4de3-ba83-84cb455f2bef service glance] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:15.741100 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f189c5-bfdc-4de3-ba83-84cb455f2bef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:15.839046 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f189c5-bfdc-4de3-ba83-84cb455f2bef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:15.840555 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f189c5-bfdc-4de3-ba83-84cb455f2bef service glance] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:15.857287 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 598/1194] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:24:15 2022] GET /identity/v3/auth/tokens => generated 2802 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:24:23.734510 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54be5f-cafd-4aa3-8f59-29621891c8ca None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:23.735104 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54be5f-cafd-4aa3-8f59-29621891c8ca None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:23.735201 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54be5f-cafd-4aa3-8f59-29621891c8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:23.754537 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-6e54be5f-cafd-4aa3-8f59-29621891c8ca None None] MFA Rules not processed for user `04cc20b616664af287ba2cd3c314cb49`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:24:23.755781 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-6e54be5f-cafd-4aa3-8f59-29621891c8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:23.762959 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 597/1195] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 16:24:23 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:24:24.076888 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e21f78-e33b-4945-ae0b-12c70debf802 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:24.077425 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e21f78-e33b-4945-ae0b-12c70debf802 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:24.077600 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e21f78-e33b-4945-ae0b-12c70debf802 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:24.078940 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 599/1196] 10.222.0.65 () {54 vars in 962 bytes} [Wed Jul 27 16:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:24:24.086153 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f63acf-aa38-40e3-89b6-ce4f8f809f8f None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:24.086870 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f63acf-aa38-40e3-89b6-ce4f8f809f8f None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:24.087215 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f63acf-aa38-40e3-89b6-ce4f8f809f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:24.130269 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-12f63acf-aa38-40e3-89b6-ce4f8f809f8f None None] MFA Rules not processed for user `66768f9443c046b3bd75853a4b2b980e`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:24:24.131887 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-12f63acf-aa38-40e3-89b6-ce4f8f809f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:24.199063 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 598/1197] 10.222.0.65 () {58 vars in 1059 bytes} [Wed Jul 27 16:24:24 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:24:24.204631 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db312ca-11ed-48ad-bac8-ee7239db96c5 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:24.205041 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db312ca-11ed-48ad-bac8-ee7239db96c5 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:24.205394 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db312ca-11ed-48ad-bac8-ee7239db96c5 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:24.206804 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 600/1198] 10.222.0.65 () {54 vars in 912 bytes} [Wed Jul 27 16:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:24:24.212115 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a32e1-c29d-418c-be22-5a4b2e19b205 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:24.212407 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a32e1-c29d-418c-be22-5a4b2e19b205 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:24.212686 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a32e1-c29d-418c-be22-5a4b2e19b205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:24.232971 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-4f0a32e1-c29d-418c-be22-5a4b2e19b205 None None] MFA Rules not processed for user `66768f9443c046b3bd75853a4b2b980e`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:24:24.234183 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-4f0a32e1-c29d-418c-be22-5a4b2e19b205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:24.243468 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 599/1199] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 16:24:24 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:24:24.254907 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db312ca-11ed-48ad-bac8-ee7239db96c5 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:24.256745 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-8db312ca-11ed-48ad-bac8-ee7239db96c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:24.271055 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db312ca-11ed-48ad-bac8-ee7239db96c5 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:24.277349 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d7616-9dfc-4110-a8b6-a8876df01259 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43377fb5ab3c4ddfb54b3b2cae8eb351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:24.277349 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d7616-9dfc-4110-a8b6-a8876df01259 service glance] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:24.277349 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d7616-9dfc-4110-a8b6-a8876df01259 service glance] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:24.277349 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d7616-9dfc-4110-a8b6-a8876df01259 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:24.289020 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d7616-9dfc-4110-a8b6-a8876df01259 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:24.290523 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d7616-9dfc-4110-a8b6-a8876df01259 service glance] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:24.301199 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 601/1200] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:24:24 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:24:24.768293 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f49ba7-82f9-441d-8461-57b7d1aad99d None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:24.768873 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f49ba7-82f9-441d-8461-57b7d1aad99d None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:24.768873 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f49ba7-82f9-441d-8461-57b7d1aad99d None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:24.770297 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 600/1201] 10.222.0.65 () {54 vars in 912 bytes} [Wed Jul 27 16:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:24:24.775915 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e566665-9669-4bca-ad2f-9731def05c50 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:24.776219 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e566665-9669-4bca-ad2f-9731def05c50 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:24.776504 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e566665-9669-4bca-ad2f-9731def05c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:24.809868 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-8e566665-9669-4bca-ad2f-9731def05c50 None None] MFA Rules not processed for user `6a95bd511e264733bf7ea71b28ad96ab`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:24:24.810610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-8e566665-9669-4bca-ad2f-9731def05c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:24.865445 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 602/1202] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 16:24:24 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:24:24.876555 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f49ba7-82f9-441d-8461-57b7d1aad99d None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:24.888074 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f49ba7-82f9-441d-8461-57b7d1aad99d None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:24.891965 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab52085-76dc-41bb-9352-c08bfc460296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:24.892584 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab52085-76dc-41bb-9352-c08bfc460296 service neutron] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:24.892866 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab52085-76dc-41bb-9352-c08bfc460296 service neutron] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:24.893141 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab52085-76dc-41bb-9352-c08bfc460296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:24.901528 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab52085-76dc-41bb-9352-c08bfc460296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:24.902958 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab52085-76dc-41bb-9352-c08bfc460296 service neutron] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:24.912016 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 601/1203] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:24:24 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:24:25.334276 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b7cb7-2843-4b05-860e-8f22c50f1bcd None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:25.334869 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b7cb7-2843-4b05-860e-8f22c50f1bcd None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:25.334978 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b7cb7-2843-4b05-860e-8f22c50f1bcd None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:25.336465 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 603/1204] 10.222.0.65 () {54 vars in 962 bytes} [Wed Jul 27 16:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:24:25.342849 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e69634-564a-4aa1-9d6d-1b3967515b5c None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:25.343222 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e69634-564a-4aa1-9d6d-1b3967515b5c None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:25.343579 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e69634-564a-4aa1-9d6d-1b3967515b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:25.362000 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc23dd-a66e-4af2-9354-0a697534e6a4 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:25.362295 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc23dd-a66e-4af2-9354-0a697534e6a4 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:25.362600 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc23dd-a66e-4af2-9354-0a697534e6a4 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:25.364124 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 604/1205] 10.222.0.65 () {54 vars in 961 bytes} [Wed Jul 27 16:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:24:25.364868 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-b6e69634-564a-4aa1-9d6d-1b3967515b5c None None] MFA Rules not processed for user `66768f9443c046b3bd75853a4b2b980e`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:24:25.366130 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-b6e69634-564a-4aa1-9d6d-1b3967515b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:25.372247 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f93e7-e51b-49bd-aee3-877e0de77dd3 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:25.372770 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f93e7-e51b-49bd-aee3-877e0de77dd3 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:25.373063 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f93e7-e51b-49bd-aee3-877e0de77dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:25.375631 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 602/1206] 10.222.0.65 () {58 vars in 1059 bytes} [Wed Jul 27 16:24:25 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:24:25.383073 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b73bd-655a-451a-97dc-9d915f8086a1 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:25.383394 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b73bd-655a-451a-97dc-9d915f8086a1 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:25.383686 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b73bd-655a-451a-97dc-9d915f8086a1 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:25.385856 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 603/1207] 10.222.0.65 () {54 vars in 912 bytes} [Wed Jul 27 16:24:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:24:25.392027 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341d71f-07a6-4cbf-ae15-e00c51befdd8 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:25.392323 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341d71f-07a6-4cbf-ae15-e00c51befdd8 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:25.392603 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341d71f-07a6-4cbf-ae15-e00c51befdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:25.394654 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-a02f93e7-e51b-49bd-aee3-877e0de77dd3 None None] MFA Rules not processed for user `c311ccdc0d434bb6a9ef99da9a5404bf`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:24:25.395887 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-a02f93e7-e51b-49bd-aee3-877e0de77dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:25.400451 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:25.402222 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=100 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:25.414951 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-a341d71f-07a6-4cbf-ae15-e00c51befdd8 None None] MFA Rules not processed for user `66768f9443c046b3bd75853a4b2b980e`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:24:25.416314 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-a341d71f-07a6-4cbf-ae15-e00c51befdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:25.426073 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 604/1208] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 16:24:25 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:24:25.440261 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341d71f-07a6-4cbf-ae15-e00c51befdd8 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:25.451505 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341d71f-07a6-4cbf-ae15-e00c51befdd8 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:25.455314 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec1e68-6138-470a-95c0-2f0c93b07bde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:25.455977 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec1e68-6138-470a-95c0-2f0c93b07bde service neutron] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:25.456461 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec1e68-6138-470a-95c0-2f0c93b07bde service neutron] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:25.456930 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec1e68-6138-470a-95c0-2f0c93b07bde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:25.469006 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec1e68-6138-470a-95c0-2f0c93b07bde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:25.470529 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec1e68-6138-470a-95c0-2f0c93b07bde service neutron] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:25.477463 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 605/1209] 10.222.0.65 () {58 vars in 1058 bytes} [Wed Jul 27 16:24:25 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:24:25.482535 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 605/1210] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:24:25 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:24:25.485002 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f93e7-e51b-49bd-aee3-877e0de77dd3 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:25.496379 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f93e7-e51b-49bd-aee3-877e0de77dd3 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:25.501673 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bffa4-0905-49d9-85c3-d264e5d90a65 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c311ccdc0d434bb6a9ef99da9a5404bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:25.502303 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bffa4-0905-49d9-85c3-d264e5d90a65 service placement] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:25.502590 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bffa4-0905-49d9-85c3-d264e5d90a65 service placement] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:25.502869 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bffa4-0905-49d9-85c3-d264e5d90a65 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:25.504688 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-233bffa4-0905-49d9-85c3-d264e5d90a65 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:25.517005 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233bffa4-0905-49d9-85c3-d264e5d90a65 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:25.518632 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233bffa4-0905-49d9-85c3-d264e5d90a65 service placement] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:25.533509 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 606/1211] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:24:25 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:24:35.482793 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=7 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:35.525136 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=31 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:36.501113 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881a847-fe30-4fb1-b2b4-dea4ae4521cc None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:36.501671 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881a847-fe30-4fb1-b2b4-dea4ae4521cc None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:36.501831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881a847-fe30-4fb1-b2b4-dea4ae4521cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:36.525898 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-f881a847-fe30-4fb1-b2b4-dea4ae4521cc None None] MFA Rules not processed for user `6a95bd511e264733bf7ea71b28ad96ab`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:24:36.527106 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-f881a847-fe30-4fb1-b2b4-dea4ae4521cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:36.534143 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 606/1212] 10.222.0.69 () {58 vars in 1015 bytes} [Wed Jul 27 16:24:36 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:24:36.546256 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bffa4-0905-49d9-85c3-d264e5d90a65 service placement] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:36.556361 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bffa4-0905-49d9-85c3-d264e5d90a65 service placement] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:36.560276 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd19364-6e10-4273-9b6d-1240dd8f9397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:36.560895 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd19364-6e10-4273-9b6d-1240dd8f9397 service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:36.561177 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd19364-6e10-4273-9b6d-1240dd8f9397 service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:36.561451 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd19364-6e10-4273-9b6d-1240dd8f9397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:36.570114 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd19364-6e10-4273-9b6d-1240dd8f9397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:36.573222 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd19364-6e10-4273-9b6d-1240dd8f9397 service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:36.583830 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 607/1213] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:24:36 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:24:37.526283 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cce38d-1909-4fcc-a710-376f6fdedcad None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:37.527217 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cce38d-1909-4fcc-a710-376f6fdedcad None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:37.527965 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cce38d-1909-4fcc-a710-376f6fdedcad None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:37.530079 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 607/1214] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 16:24:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:24:37.573827 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef773fc6-2584-4fd7-9fa1-14c434849feb None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:37.574386 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef773fc6-2584-4fd7-9fa1-14c434849feb None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:37.574386 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef773fc6-2584-4fd7-9fa1-14c434849feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:37.600980 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-ef773fc6-2584-4fd7-9fa1-14c434849feb None None] MFA Rules not processed for user `66768f9443c046b3bd75853a4b2b980e`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:24:37.602906 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-ef773fc6-2584-4fd7-9fa1-14c434849feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:37.613836 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 608/1215] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 16:24:37 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:24:37.630291 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cce38d-1909-4fcc-a710-376f6fdedcad None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:37.644895 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cce38d-1909-4fcc-a710-376f6fdedcad None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:37.651159 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d84ff9-d72b-4133-a1ff-8f7bfb89ffbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:37.651954 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d84ff9-d72b-4133-a1ff-8f7bfb89ffbb service nova] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:37.652250 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d84ff9-d72b-4133-a1ff-8f7bfb89ffbb service nova] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:37.652530 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d84ff9-d72b-4133-a1ff-8f7bfb89ffbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:37.662543 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d84ff9-d72b-4133-a1ff-8f7bfb89ffbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:37.664742 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d84ff9-d72b-4133-a1ff-8f7bfb89ffbb service nova] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:37.690237 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 608/1216] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:24:37 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:24:44.032638 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422de39-dfd4-47b4-8c9b-c185ebaa4227 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:44.033590 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422de39-dfd4-47b4-8c9b-c185ebaa4227 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:44.034037 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422de39-dfd4-47b4-8c9b-c185ebaa4227 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:44.035768 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 609/1217] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 16:24:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:24:44.050316 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce467054-0de9-4f9a-ad73-a1fc53306763 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:44.050916 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce467054-0de9-4f9a-ad73-a1fc53306763 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:44.050916 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce467054-0de9-4f9a-ad73-a1fc53306763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:44.100134 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-ce467054-0de9-4f9a-ad73-a1fc53306763 None None] MFA Rules not processed for user `66768f9443c046b3bd75853a4b2b980e`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:24:44.102132 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-ce467054-0de9-4f9a-ad73-a1fc53306763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:44.112673 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 609/1218] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 16:24:44 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:24:44.129855 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422de39-dfd4-47b4-8c9b-c185ebaa4227 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:44.146808 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422de39-dfd4-47b4-8c9b-c185ebaa4227 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:44.151858 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35d5ec-2359-45fd-a0f3-f6cddfd907bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:44.152472 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35d5ec-2359-45fd-a0f3-f6cddfd907bd service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:44.152748 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35d5ec-2359-45fd-a0f3-f6cddfd907bd service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:44.153021 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35d5ec-2359-45fd-a0f3-f6cddfd907bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:44.162358 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35d5ec-2359-45fd-a0f3-f6cddfd907bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:44.164787 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35d5ec-2359-45fd-a0f3-f6cddfd907bd service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:44.175148 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 610/1219] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:24:44 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:24:54.081068 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=12 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:54.171392 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=15 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:56.320319 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce467054-0de9-4f9a-ad73-a1fc53306763 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:56.329877 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce467054-0de9-4f9a-ad73-a1fc53306763 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:56.333444 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb13350-744e-4054-8c21-a51d1caf9359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:56.334284 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb13350-744e-4054-8c21-a51d1caf9359 service neutron] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:56.334560 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb13350-744e-4054-8c21-a51d1caf9359 service neutron] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:56.334838 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb13350-744e-4054-8c21-a51d1caf9359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:56.344242 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb13350-744e-4054-8c21-a51d1caf9359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:56.345661 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb13350-744e-4054-8c21-a51d1caf9359 service neutron] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:56.355590 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 610/1220] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:24:56 2022] GET /identity/v3/auth/tokens => generated 2877 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:24:58.376248 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb2271-a24c-4bf8-a400-efe5fbeed16b None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:58.376870 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb2271-a24c-4bf8-a400-efe5fbeed16b None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:58.376870 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb2271-a24c-4bf8-a400-efe5fbeed16b None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:58.378695 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 611/1221] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 16:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:24:58.388135 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a063c-ea76-4171-a635-2af616bd27f9 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:58.389120 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a063c-ea76-4171-a635-2af616bd27f9 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:58.389873 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a063c-ea76-4171-a635-2af616bd27f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:58.417533 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-073a063c-ea76-4171-a635-2af616bd27f9 None None] MFA Rules not processed for user `66768f9443c046b3bd75853a4b2b980e`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:24:58.419671 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-073a063c-ea76-4171-a635-2af616bd27f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:58.429948 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 611/1222] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 16:24:58 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:24:58.442739 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb2271-a24c-4bf8-a400-efe5fbeed16b None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:58.467287 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb2271-a24c-4bf8-a400-efe5fbeed16b None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:58.475577 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8afe16-6d97-4802-9f78-ce6ea486a8b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:58.477613 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8afe16-6d97-4802-9f78-ce6ea486a8b7 service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:58.477613 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8afe16-6d97-4802-9f78-ce6ea486a8b7 service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:58.478364 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8afe16-6d97-4802-9f78-ce6ea486a8b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:58.489041 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8afe16-6d97-4802-9f78-ce6ea486a8b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:58.490659 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8afe16-6d97-4802-9f78-ce6ea486a8b7 service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:58.503409 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 612/1223] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:24:58 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:25:08.411271 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=9 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:25:08.497909 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=6 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:25:14.749286 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d6474-55e7-4181-b439-98896050b3ac None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:25:14.749812 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d6474-55e7-4181-b439-98896050b3ac None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:25:14.749924 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d6474-55e7-4181-b439-98896050b3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:25:14.768618 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-a97d6474-55e7-4181-b439-98896050b3ac None None] MFA Rules not processed for user `57c1a8c5c03b41f29a671b68bb64b403`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:25:14.769823 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-a97d6474-55e7-4181-b439-98896050b3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:25:14.777201 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 612/1224] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 16:25:14 2022] POST /identity/v3/auth/tokens => generated 2802 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:25:24.763408 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=3 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:25:37.600536 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35df74-c463-4be7-bb19-935d43d52cb9 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:25:37.601038 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35df74-c463-4be7-bb19-935d43d52cb9 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:25:37.601139 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35df74-c463-4be7-bb19-935d43d52cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:25:37.620861 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-9c35df74-c463-4be7-bb19-935d43d52cb9 None None] MFA Rules not processed for user `57c1a8c5c03b41f29a671b68bb64b403`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:25:37.622077 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-9c35df74-c463-4be7-bb19-935d43d52cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:25:37.628982 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 613/1225] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 16:25:37 2022] POST /identity/v3/auth/tokens => generated 2802 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:25:47.615287 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=3 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:25:50.113734 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56e7ff-09bc-45ab-bb4e-c7e237ae07e3 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:25:50.114230 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56e7ff-09bc-45ab-bb4e-c7e237ae07e3 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:25:50.114337 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56e7ff-09bc-45ab-bb4e-c7e237ae07e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:25:50.133370 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-ee56e7ff-09bc-45ab-bb4e-c7e237ae07e3 None None] MFA Rules not processed for user `57c1a8c5c03b41f29a671b68bb64b403`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:25:50.134561 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-ee56e7ff-09bc-45ab-bb4e-c7e237ae07e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:25:50.141388 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 613/1226] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 16:25:50 2022] POST /identity/v3/auth/tokens => generated 2802 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:26:00.127798 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=3 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:46.602875 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d0fdb-d220-4de0-b706-07d9c1012989 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:46.603416 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d0fdb-d220-4de0-b706-07d9c1012989 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:46.603512 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d0fdb-d220-4de0-b706-07d9c1012989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:46.621957 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-163d0fdb-d220-4de0-b706-07d9c1012989 None None] MFA Rules not processed for user `57c1a8c5c03b41f29a671b68bb64b403`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:26:46.623086 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-163d0fdb-d220-4de0-b706-07d9c1012989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:46.630372 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 614/1227] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 16:26:46 2022] POST /identity/v3/auth/tokens => generated 2802 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:26:46.960082 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b4841-2486-431b-a1df-b252a7f171e4 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:46.960555 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b4841-2486-431b-a1df-b252a7f171e4 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:46.960638 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b4841-2486-431b-a1df-b252a7f171e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:47.007761 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-4c8b4841-2486-431b-a1df-b252a7f171e4 None None] MFA Rules not processed for user `6a95bd511e264733bf7ea71b28ad96ab`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:26:47.008965 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-4c8b4841-2486-431b-a1df-b252a7f171e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:47.024549 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 614/1228] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 16:26:46 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:26:47.036385 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d0fdb-d220-4de0-b706-07d9c1012989 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:26:47.045819 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d0fdb-d220-4de0-b706-07d9c1012989 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:26:47.049362 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383aac52-46ac-4760-b3a5-934de466281b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:26:47.049969 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383aac52-46ac-4760-b3a5-934de466281b service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:47.050887 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383aac52-46ac-4760-b3a5-934de466281b service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:47.051179 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383aac52-46ac-4760-b3a5-934de466281b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:47.058387 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383aac52-46ac-4760-b3a5-934de466281b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:26:47.060005 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383aac52-46ac-4760-b3a5-934de466281b service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:26:47.068619 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 615/1229] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:26:47 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:26:57.021592 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=17 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:57.064857 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=9 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:58.600807 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b4841-2486-431b-a1df-b252a7f171e4 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:26:58.609272 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b4841-2486-431b-a1df-b252a7f171e4 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:26:58.612898 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9ae95-2acb-4f9e-8805-8489f5be26b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:26:58.613518 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9ae95-2acb-4f9e-8805-8489f5be26b2 service neutron] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:58.614538 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9ae95-2acb-4f9e-8805-8489f5be26b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:58.614823 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9ae95-2acb-4f9e-8805-8489f5be26b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:58.624247 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9ae95-2acb-4f9e-8805-8489f5be26b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:26:58.625691 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9ae95-2acb-4f9e-8805-8489f5be26b2 service neutron] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:26:58.635018 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 615/1230] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:26:58 2022] GET /identity/v3/auth/tokens => generated 2873 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:27:08.630892 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=6 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:23.188273 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383aac52-46ac-4760-b3a5-934de466281b service neutron] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:28:23.211020 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383aac52-46ac-4760-b3a5-934de466281b service neutron] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:28:23.216493 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf760ac-1625-4302-9e23-5139402cdfc2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c311ccdc0d434bb6a9ef99da9a5404bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:28:23.217116 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf760ac-1625-4302-9e23-5139402cdfc2 service placement] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:23.217404 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf760ac-1625-4302-9e23-5139402cdfc2 service placement] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:23.217681 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf760ac-1625-4302-9e23-5139402cdfc2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:23.226314 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf760ac-1625-4302-9e23-5139402cdfc2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:28:23.227992 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf760ac-1625-4302-9e23-5139402cdfc2 service placement] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:28:23.238427 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 616/1231] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:28:23 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:28:33.233625 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=10 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:43.923805 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64e30c-7e05-4017-a73e-2c61f31346a8 None None] REQUEST_METHOD: `POST` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:43.924318 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64e30c-7e05-4017-a73e-2c61f31346a8 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:43.924318 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64e30c-7e05-4017-a73e-2c61f31346a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:43.944244 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.auth.core [None req-8b64e30c-7e05-4017-a73e-2c61f31346a8 None None] MFA Rules not processed for user `04cc20b616664af287ba2cd3c314cb49`. Rule list: `[]` (Enabled: `True`). {{(pid=87086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:28:43.945463 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-8b64e30c-7e05-4017-a73e-2c61f31346a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:43.952322 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 616/1232] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 16:28:43 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:28:53.939006 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=3 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:29:09.262725 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48207111-014e-4f93-9699-858eb475aedf None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:29:09.263650 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48207111-014e-4f93-9699-858eb475aedf None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:29:09.264119 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48207111-014e-4f93-9699-858eb475aedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:29:09.288435 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-48207111-014e-4f93-9699-858eb475aedf None None] MFA Rules not processed for user `57c1a8c5c03b41f29a671b68bb64b403`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:29:09.289962 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-48207111-014e-4f93-9699-858eb475aedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:29:09.303699 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 617/1233] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 16:29:09 2022] POST /identity/v3/auth/tokens => generated 2802 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:29:15.051635 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64e30c-7e05-4017-a73e-2c61f31346a8 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:29:15.072514 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64e30c-7e05-4017-a73e-2c61f31346a8 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:29:15.077438 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e9f53-87c0-4102-8f2f-48263fc9abf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:29:15.078038 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e9f53-87c0-4102-8f2f-48263fc9abf3 service nova] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:29:15.078323 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e9f53-87c0-4102-8f2f-48263fc9abf3 service nova] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:29:15.078595 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e9f53-87c0-4102-8f2f-48263fc9abf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:29:15.086887 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e9f53-87c0-4102-8f2f-48263fc9abf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:29:15.088476 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e9f53-87c0-4102-8f2f-48263fc9abf3 service nova] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:29:15.098137 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 617/1234] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:29:15 2022] GET /identity/v3/auth/tokens => generated 2802 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:29:19.282734 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=3 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:29:25.093789 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=10 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:29:35.295772 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48207111-014e-4f93-9699-858eb475aedf None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:29:35.308088 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48207111-014e-4f93-9699-858eb475aedf None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:29:35.313039 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223acab-5aa6-4826-9e14-4069ad72098b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:29:35.313653 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223acab-5aa6-4826-9e14-4069ad72098b service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:29:35.313947 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223acab-5aa6-4826-9e14-4069ad72098b service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:29:35.314223 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223acab-5aa6-4826-9e14-4069ad72098b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:29:35.322315 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223acab-5aa6-4826-9e14-4069ad72098b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:29:35.323992 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223acab-5aa6-4826-9e14-4069ad72098b service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:29:35.332881 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 618/1235] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:29:35 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:29:35.485151 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e9f53-87c0-4102-8f2f-48263fc9abf3 service nova] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:29:35.488497 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223acab-5aa6-4826-9e14-4069ad72098b service nova] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:29:35.495878 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e9f53-87c0-4102-8f2f-48263fc9abf3 service nova] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:29:35.498419 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223acab-5aa6-4826-9e14-4069ad72098b service nova] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:29:35.499654 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a6776-3b88-4759-a343-106f219cd65b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:29:35.500300 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a6776-3b88-4759-a343-106f219cd65b service neutron] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:29:35.500584 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a6776-3b88-4759-a343-106f219cd65b service neutron] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:29:35.500865 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a6776-3b88-4759-a343-106f219cd65b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:29:35.502127 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dba48c-f024-43b5-abb2-764ea610efe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:29:35.502799 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dba48c-f024-43b5-abb2-764ea610efe5 service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:29:35.503145 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dba48c-f024-43b5-abb2-764ea610efe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:29:35.503550 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dba48c-f024-43b5-abb2-764ea610efe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:29:35.510969 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a6776-3b88-4759-a343-106f219cd65b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:29:35.511294 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dba48c-f024-43b5-abb2-764ea610efe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:29:35.512596 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a6776-3b88-4759-a343-106f219cd65b service neutron] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:29:35.512878 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dba48c-f024-43b5-abb2-764ea610efe5 service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:29:35.520692 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 619/1236] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:29:35 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:29:35.526177 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 618/1237] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:29:35 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:29:36.822256 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dba48c-f024-43b5-abb2-764ea610efe5 service neutron] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:29:36.830578 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dba48c-f024-43b5-abb2-764ea610efe5 service neutron] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:29:36.834140 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3c0e7-c059-4ac0-ad38-21919d6744b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:29:36.835364 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3c0e7-c059-4ac0-ad38-21919d6744b2 service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:29:36.835683 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3c0e7-c059-4ac0-ad38-21919d6744b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:29:36.835965 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3c0e7-c059-4ac0-ad38-21919d6744b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:29:36.845226 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3c0e7-c059-4ac0-ad38-21919d6744b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:29:36.846687 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3c0e7-c059-4ac0-ad38-21919d6744b2 service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:29:36.856707 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 620/1238] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:29:36 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:29:45.519029 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=6 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:29:46.852341 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=18 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:30:20.732718 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a6776-3b88-4759-a343-106f219cd65b service neutron] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:30:20.747119 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a6776-3b88-4759-a343-106f219cd65b service neutron] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:30:20.762524 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03c53c-7a55-4844-a509-44236769a822 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:30:20.762912 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03c53c-7a55-4844-a509-44236769a822 service nova] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:30:20.763354 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03c53c-7a55-4844-a509-44236769a822 service nova] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:30:20.763999 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03c53c-7a55-4844-a509-44236769a822 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:30:20.781434 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03c53c-7a55-4844-a509-44236769a822 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:30:20.782867 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03c53c-7a55-4844-a509-44236769a822 service nova] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:30:20.809984 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 619/1239] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:30:20 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:30:29.129374 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3c0e7-c059-4ac0-ad38-21919d6744b2 service neutron] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:30:29.139511 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3c0e7-c059-4ac0-ad38-21919d6744b2 service neutron] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:30:29.143343 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5124766-bc77-4bc3-b8fe-7e53f56b2eb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:30:29.144073 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5124766-bc77-4bc3-b8fe-7e53f56b2eb1 service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:30:29.144433 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5124766-bc77-4bc3-b8fe-7e53f56b2eb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:30:29.144780 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5124766-bc77-4bc3-b8fe-7e53f56b2eb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:30:29.210366 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5124766-bc77-4bc3-b8fe-7e53f56b2eb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:30:29.211855 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5124766-bc77-4bc3-b8fe-7e53f56b2eb1 service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:30:29.232054 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 621/1240] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:30:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:30:30.799494 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=6 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:30:32.890117 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f1478-c0f7-4178-897d-0db5960adaf9 None None] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:30:32.891053 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f1478-c0f7-4178-897d-0db5960adaf9 None None] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:30:32.891410 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f1478-c0f7-4178-897d-0db5960adaf9 None None] PATH_INFO: `/` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:30:32.892926 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 620/1241] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 16:30:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:30:32.901411 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32adabe-317f-4730-9881-a08bb47a8cda None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:30:32.901990 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32adabe-317f-4730-9881-a08bb47a8cda None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:30:32.902134 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32adabe-317f-4730-9881-a08bb47a8cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:30:32.969364 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-f32adabe-317f-4730-9881-a08bb47a8cda None None] MFA Rules not processed for user `c311ccdc0d434bb6a9ef99da9a5404bf`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:30:32.970853 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-f32adabe-317f-4730-9881-a08bb47a8cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:30:32.981821 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 622/1242] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 16:30:32 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:30:33.010746 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f1478-c0f7-4178-897d-0db5960adaf9 None None] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:30:33.025992 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f1478-c0f7-4178-897d-0db5960adaf9 None None] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:30:33.031127 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aaca6a-7213-4e0e-aadb-e255610031bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c311ccdc0d434bb6a9ef99da9a5404bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:30:33.031845 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aaca6a-7213-4e0e-aadb-e255610031bb service placement] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:30:33.032135 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aaca6a-7213-4e0e-aadb-e255610031bb service placement] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:30:33.032595 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aaca6a-7213-4e0e-aadb-e255610031bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:30:33.041609 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aaca6a-7213-4e0e-aadb-e255610031bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:30:33.043831 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aaca6a-7213-4e0e-aadb-e255610031bb service placement] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:30:33.054997 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 621/1243] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:30:33 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:30:36.126950 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32adabe-317f-4730-9881-a08bb47a8cda None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:30:36.141234 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32adabe-317f-4730-9881-a08bb47a8cda None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:30:36.145893 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5230510-3553-40b9-9fea-9fd63f72876d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:30:36.146663 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5230510-3553-40b9-9fea-9fd63f72876d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:30:36.146964 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5230510-3553-40b9-9fea-9fd63f72876d admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:30:36.147230 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5230510-3553-40b9-9fea-9fd63f72876d admin admin] PATH_INFO: `/v3/users/04cc20b616664af287ba2cd3c314cb49` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:30:36.148433 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5230510-3553-40b9-9fea-9fd63f72876d admin admin] RBAC: Authorizing `identity:delete_user(user_id=04cc20b616664af287ba2cd3c314cb49)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:30:36.150384 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5230510-3553-40b9-9fea-9fd63f72876d admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:30:36.202052 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-a5230510-3553-40b9-9fea-9fd63f72876d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04cc20b616664af287ba2cd3c314cb49'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:30:36.202696 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-a5230510-3553-40b9-9fea-9fd63f72876d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04cc20b616664af287ba2cd3c314cb49'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:30:36.209898 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-a5230510-3553-40b9-9fea-9fd63f72876d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04cc20b616664af287ba2cd3c314cb49'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:30:36.210528 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-a5230510-3553-40b9-9fea-9fd63f72876d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04cc20b616664af287ba2cd3c314cb49'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:30:36.217632 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-a5230510-3553-40b9-9fea-9fd63f72876d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04cc20b616664af287ba2cd3c314cb49'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:30:36.234838 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 623/1244] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 16:30:36 2022] DELETE /identity/v3/users/04cc20b616664af287ba2cd3c314cb49 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:30:36.425111 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aaca6a-7213-4e0e-aadb-e255610031bb service placement] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:30:36.436640 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aaca6a-7213-4e0e-aadb-e255610031bb service placement] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:30:36.495494 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af271e37-6499-430b-b113-f7851e040261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:30:36.496160 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af271e37-6499-430b-b113-f7851e040261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:30:36.496443 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af271e37-6499-430b-b113-f7851e040261 admin admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:30:36.496727 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af271e37-6499-430b-b113-f7851e040261 admin admin] PATH_INFO: `/v3/projects/5e6ff3c0fcc448dc880516ef28f8bc7c` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:30:36.497901 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af271e37-6499-430b-b113-f7851e040261 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e6ff3c0fcc448dc880516ef28f8bc7c)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:30:36.499862 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af271e37-6499-430b-b113-f7851e040261 admin admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:30:36.548117 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [None req-af271e37-6499-430b-b113-f7851e040261 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e6ff3c0fcc448dc880516ef28f8bc7c', 'request_id': 'req-af271e37-6499-430b-b113-f7851e040261'} {{(pid=87086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:30:36.553582 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [None req-af271e37-6499-430b-b113-f7851e040261 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e6ff3c0fcc448dc880516ef28f8bc7c', 'request_id': 'req-af271e37-6499-430b-b113-f7851e040261'} {{(pid=87086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:30:36.560758 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [None req-af271e37-6499-430b-b113-f7851e040261 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e6ff3c0fcc448dc880516ef28f8bc7c', 'request_id': 'req-af271e37-6499-430b-b113-f7851e040261'} {{(pid=87086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:30:36.572077 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [None req-af271e37-6499-430b-b113-f7851e040261 admin admin] The token cache is being invalidate because project 5e6ff3c0fcc448dc880516ef28f8bc7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:30:36.572359 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [None req-af271e37-6499-430b-b113-f7851e040261 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:30:36.572988 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [None req-af271e37-6499-430b-b113-f7851e040261 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:30:36.574499 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 622/1245] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 16:30:36 2022] DELETE /identity/v3/projects/5e6ff3c0fcc448dc880516ef28f8bc7c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:30:36.578732 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5230510-3553-40b9-9fea-9fd63f72876d admin admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:30:36.580142 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-a5230510-3553-40b9-9fea-9fd63f72876d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:30:36.593795 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5230510-3553-40b9-9fea-9fd63f72876d admin admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:30:36.619124 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:30:36.653338 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e0fff-51d3-49be-bd67-abdc27e06b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:30:36.653987 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e0fff-51d3-49be-bd67-abdc27e06b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:30:36.654280 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e0fff-51d3-49be-bd67-abdc27e06b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:30:36.654558 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e0fff-51d3-49be-bd67-abdc27e06b43 admin admin] PATH_INFO: `/v3/users/f7f2a7472a3c4dadb251a8e7b78ca08b` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:30:36.655750 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e0fff-51d3-49be-bd67-abdc27e06b43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7f2a7472a3c4dadb251a8e7b78ca08b)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:30:36.657691 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e0fff-51d3-49be-bd67-abdc27e06b43 admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:30:36.703137 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-933e0fff-51d3-49be-bd67-abdc27e06b43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7f2a7472a3c4dadb251a8e7b78ca08b'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:30:36.703841 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-933e0fff-51d3-49be-bd67-abdc27e06b43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7f2a7472a3c4dadb251a8e7b78ca08b'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:30:36.712306 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-933e0fff-51d3-49be-bd67-abdc27e06b43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7f2a7472a3c4dadb251a8e7b78ca08b'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:30:36.712961 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-933e0fff-51d3-49be-bd67-abdc27e06b43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7f2a7472a3c4dadb251a8e7b78ca08b'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:30:36.720555 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-933e0fff-51d3-49be-bd67-abdc27e06b43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7f2a7472a3c4dadb251a8e7b78ca08b'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:30:36.737518 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 624/1246] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 16:30:36 2022] DELETE /identity/v3/users/f7f2a7472a3c4dadb251a8e7b78ca08b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:30:36.912854 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af271e37-6499-430b-b113-f7851e040261 admin admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:30:36.914329 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-af271e37-6499-430b-b113-f7851e040261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:30:36.927464 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af271e37-6499-430b-b113-f7851e040261 admin admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:30:36.985254 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806bc24-3fa3-40d1-bf4b-645a6da0415a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:30:36.985906 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806bc24-3fa3-40d1-bf4b-645a6da0415a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:30:36.986190 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806bc24-3fa3-40d1-bf4b-645a6da0415a admin admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:30:36.986471 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806bc24-3fa3-40d1-bf4b-645a6da0415a admin admin] PATH_INFO: `/v3/projects/20f30a1d662641a3b7323af0249aa89f` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:30:36.987671 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806bc24-3fa3-40d1-bf4b-645a6da0415a admin admin] RBAC: Authorizing `identity:delete_project(project_id=20f30a1d662641a3b7323af0249aa89f)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:30:36.989598 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806bc24-3fa3-40d1-bf4b-645a6da0415a admin admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:30:37.009942 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:30:37.037920 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [None req-1806bc24-3fa3-40d1-bf4b-645a6da0415a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20f30a1d662641a3b7323af0249aa89f', 'request_id': 'req-1806bc24-3fa3-40d1-bf4b-645a6da0415a'} {{(pid=87086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:30:37.043456 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [None req-1806bc24-3fa3-40d1-bf4b-645a6da0415a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20f30a1d662641a3b7323af0249aa89f', 'request_id': 'req-1806bc24-3fa3-40d1-bf4b-645a6da0415a'} {{(pid=87086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:30:37.051025 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [None req-1806bc24-3fa3-40d1-bf4b-645a6da0415a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20f30a1d662641a3b7323af0249aa89f', 'request_id': 'req-1806bc24-3fa3-40d1-bf4b-645a6da0415a'} {{(pid=87086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:30:37.063094 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [None req-1806bc24-3fa3-40d1-bf4b-645a6da0415a admin admin] The token cache is being invalidate because project 20f30a1d662641a3b7323af0249aa89f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:30:37.063410 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [None req-1806bc24-3fa3-40d1-bf4b-645a6da0415a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:30:37.064065 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [None req-1806bc24-3fa3-40d1-bf4b-645a6da0415a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:30:37.065598 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 623/1247] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 16:30:36 2022] DELETE /identity/v3/projects/20f30a1d662641a3b7323af0249aa89f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:30:46.734070 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=41,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:30:47.059967 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:31:16.947047 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aafaec-8944-496b-bdce-f326ce2e05ef None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:31:16.947596 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aafaec-8944-496b-bdce-f326ce2e05ef None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:31:16.947689 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aafaec-8944-496b-bdce-f326ce2e05ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:31:16.967205 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-33aafaec-8944-496b-bdce-f326ce2e05ef None None] MFA Rules not processed for user `57c1a8c5c03b41f29a671b68bb64b403`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:31:16.968454 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-33aafaec-8944-496b-bdce-f326ce2e05ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:31:17.021835 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 625/1248] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 16:31:16 2022] POST /identity/v3/auth/tokens => generated 2802 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:31:17.783651 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806bc24-3fa3-40d1-bf4b-645a6da0415a admin admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:31:17.785161 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-1806bc24-3fa3-40d1-bf4b-645a6da0415a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:31:17.861516 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806bc24-3fa3-40d1-bf4b-645a6da0415a admin admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:31:17.866451 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d07794-8b9c-45fb-9166-b018ace6c91f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c311ccdc0d434bb6a9ef99da9a5404bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:31:17.867073 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d07794-8b9c-45fb-9166-b018ace6c91f service placement] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:31:17.867356 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d07794-8b9c-45fb-9166-b018ace6c91f service placement] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:31:17.867665 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d07794-8b9c-45fb-9166-b018ace6c91f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:31:17.869447 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-d5d07794-8b9c-45fb-9166-b018ace6c91f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:31:17.880919 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d07794-8b9c-45fb-9166-b018ace6c91f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:31:17.882495 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d07794-8b9c-45fb-9166-b018ace6c91f service placement] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:31:17.892788 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 624/1249] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:31:17 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:31:25.945681 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aafaec-8944-496b-bdce-f326ce2e05ef None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:31:25.947111 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-33aafaec-8944-496b-bdce-f326ce2e05ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:31:26.020953 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aafaec-8944-496b-bdce-f326ce2e05ef None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:31:26.026301 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191148d-50f6-42c5-ac5f-b02c780b05f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66768f9443c046b3bd75853a4b2b980e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:31:26.026616 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191148d-50f6-42c5-ac5f-b02c780b05f1 service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:31:26.026930 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191148d-50f6-42c5-ac5f-b02c780b05f1 service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:31:26.027205 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191148d-50f6-42c5-ac5f-b02c780b05f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:31:26.029308 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-e191148d-50f6-42c5-ac5f-b02c780b05f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:31:26.041981 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e191148d-50f6-42c5-ac5f-b02c780b05f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:31:26.044322 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e191148d-50f6-42c5-ac5f-b02c780b05f1 service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:31:26.054562 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 626/1250] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:31:25 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:31:27.888742 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=32 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:31:36.050357 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=57 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:33:29.952853 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d07794-8b9c-45fb-9166-b018ace6c91f service placement] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:33:29.954233 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-d5d07794-8b9c-45fb-9166-b018ace6c91f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:33:30.013987 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d07794-8b9c-45fb-9166-b018ace6c91f service placement] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:33:30.018960 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccb2b7-55e6-4d81-88f1-2a62309c1eab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c311ccdc0d434bb6a9ef99da9a5404bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:33:30.019605 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccb2b7-55e6-4d81-88f1-2a62309c1eab service placement] REQUEST_METHOD: `GET` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:33:30.019886 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccb2b7-55e6-4d81-88f1-2a62309c1eab service placement] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:33:30.020160 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccb2b7-55e6-4d81-88f1-2a62309c1eab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:33:30.021882 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-4cccb2b7-55e6-4d81-88f1-2a62309c1eab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:33:30.032833 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cccb2b7-55e6-4d81-88f1-2a62309c1eab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:33:30.034331 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cccb2b7-55e6-4d81-88f1-2a62309c1eab service placement] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:33:30.044021 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 625/1251] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:33:29 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:33:40.040247 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=28 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:33:54.002049 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191148d-50f6-42c5-ac5f-b02c780b05f1 service nova] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:33:54.003496 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-e191148d-50f6-42c5-ac5f-b02c780b05f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:33:54.091661 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191148d-50f6-42c5-ac5f-b02c780b05f1 service nova] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:33:54.095171 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2484a-2ec6-41d1-836d-d8bfb35a2ace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a95bd511e264733bf7ea71b28ad96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73d63a3d7b724a5998ea2976430f242d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:33:54.095861 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2484a-2ec6-41d1-836d-d8bfb35a2ace service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:33:54.096143 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2484a-2ec6-41d1-836d-d8bfb35a2ace service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:33:54.096437 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2484a-2ec6-41d1-836d-d8bfb35a2ace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:33:54.098171 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-9dc2484a-2ec6-41d1-836d-d8bfb35a2ace service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:33:54.313249 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2484a-2ec6-41d1-836d-d8bfb35a2ace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:33:54.315272 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2484a-2ec6-41d1-836d-d8bfb35a2ace service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:33:54.324952 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 627/1252] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 16:33:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:00.808290 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccb2b7-55e6-4d81-88f1-2a62309c1eab service placement] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:00.809847 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-4cccb2b7-55e6-4d81-88f1-2a62309c1eab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:00.825636 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccb2b7-55e6-4d81-88f1-2a62309c1eab service placement] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:00.830615 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f866bd8-7ebe-4d5a-aafb-5f9f744854d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:00.831261 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f866bd8-7ebe-4d5a-aafb-5f9f744854d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:00.831576 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f866bd8-7ebe-4d5a-aafb-5f9f744854d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:00.831859 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f866bd8-7ebe-4d5a-aafb-5f9f744854d2 admin admin] PATH_INFO: `/v3/users/57c1a8c5c03b41f29a671b68bb64b403` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:00.833182 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f866bd8-7ebe-4d5a-aafb-5f9f744854d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57c1a8c5c03b41f29a671b68bb64b403)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:00.834201 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: WARNING py.warnings [None req-2f866bd8-7ebe-4d5a-aafb-5f9f744854d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:34:00.834201 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: warnings.warn(msg) Jul 27 16:34:00.834201 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: Jul 27 16:34:00.835489 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f866bd8-7ebe-4d5a-aafb-5f9f744854d2 admin admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:00.899203 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [None req-2f866bd8-7ebe-4d5a-aafb-5f9f744854d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57c1a8c5c03b41f29a671b68bb64b403'} {{(pid=87086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:00.910653 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [None req-2f866bd8-7ebe-4d5a-aafb-5f9f744854d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57c1a8c5c03b41f29a671b68bb64b403'} {{(pid=87086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:00.911408 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [None req-2f866bd8-7ebe-4d5a-aafb-5f9f744854d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57c1a8c5c03b41f29a671b68bb64b403'} {{(pid=87086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:00.919022 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [None req-2f866bd8-7ebe-4d5a-aafb-5f9f744854d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57c1a8c5c03b41f29a671b68bb64b403'} {{(pid=87086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:00.937819 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [None req-2f866bd8-7ebe-4d5a-aafb-5f9f744854d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57c1a8c5c03b41f29a671b68bb64b403'} {{(pid=87086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:00.944110 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 626/1253] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 16:34:00 2022] DELETE /identity/v3/users/57c1a8c5c03b41f29a671b68bb64b403 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:01.119936 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2484a-2ec6-41d1-836d-d8bfb35a2ace service neutron] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:01.131064 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2484a-2ec6-41d1-836d-d8bfb35a2ace service neutron] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:01.191535 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314d511-4692-4669-b0c2-da3b604be58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:01.192193 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314d511-4692-4669-b0c2-da3b604be58a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:01.192476 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314d511-4692-4669-b0c2-da3b604be58a admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:01.192755 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314d511-4692-4669-b0c2-da3b604be58a admin admin] PATH_INFO: `/v3/projects/e2b9ab3c8926480a82662503de2a51c8` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:01.193914 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314d511-4692-4669-b0c2-da3b604be58a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2b9ab3c8926480a82662503de2a51c8)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:01.194959 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: WARNING py.warnings [None req-9314d511-4692-4669-b0c2-da3b604be58a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:34:01.194959 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: warnings.warn(msg) Jul 27 16:34:01.194959 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: Jul 27 16:34:01.196180 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314d511-4692-4669-b0c2-da3b604be58a admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:01.198466 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:01.250330 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-9314d511-4692-4669-b0c2-da3b604be58a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2b9ab3c8926480a82662503de2a51c8', 'request_id': 'req-9314d511-4692-4669-b0c2-da3b604be58a'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:01.263142 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-9314d511-4692-4669-b0c2-da3b604be58a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2b9ab3c8926480a82662503de2a51c8', 'request_id': 'req-9314d511-4692-4669-b0c2-da3b604be58a'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:01.269954 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-9314d511-4692-4669-b0c2-da3b604be58a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2b9ab3c8926480a82662503de2a51c8', 'request_id': 'req-9314d511-4692-4669-b0c2-da3b604be58a'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:01.282179 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-9314d511-4692-4669-b0c2-da3b604be58a admin admin] The token cache is being invalidate because project e2b9ab3c8926480a82662503de2a51c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:34:01.282525 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-9314d511-4692-4669-b0c2-da3b604be58a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:01.283983 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-9314d511-4692-4669-b0c2-da3b604be58a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:01.285738 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 628/1254] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 16:34:01 2022] DELETE /identity/v3/projects/e2b9ab3c8926480a82662503de2a51c8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:01.290206 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f866bd8-7ebe-4d5a-aafb-5f9f744854d2 admin admin] Authenticating user token {{(pid=87086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:01.291729 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.fernet_utils [None req-2f866bd8-7ebe-4d5a-aafb-5f9f744854d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:01.304936 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f866bd8-7ebe-4d5a-aafb-5f9f744854d2 admin admin] Validating token access rules against request {{(pid=87086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:01.360732 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb3e19-0dbf-473b-8fcd-d55d69565b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:01.361406 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb3e19-0dbf-473b-8fcd-d55d69565b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:01.361686 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb3e19-0dbf-473b-8fcd-d55d69565b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:01.361959 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb3e19-0dbf-473b-8fcd-d55d69565b15 admin admin] PATH_INFO: `/v3/users/67e521bd96c24057b4b5dfadbb3ab03e` {{(pid=87086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:01.363105 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb3e19-0dbf-473b-8fcd-d55d69565b15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67e521bd96c24057b4b5dfadbb3ab03e)` {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:01.365077 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb3e19-0dbf-473b-8fcd-d55d69565b15 admin admin] RBAC: Authorization granted {{(pid=87086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:01.412651 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [None req-d0eb3e19-0dbf-473b-8fcd-d55d69565b15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67e521bd96c24057b4b5dfadbb3ab03e'} {{(pid=87086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:01.419885 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [None req-d0eb3e19-0dbf-473b-8fcd-d55d69565b15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67e521bd96c24057b4b5dfadbb3ab03e'} {{(pid=87086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:01.420554 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [None req-d0eb3e19-0dbf-473b-8fcd-d55d69565b15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67e521bd96c24057b4b5dfadbb3ab03e'} {{(pid=87086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:01.427937 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [None req-d0eb3e19-0dbf-473b-8fcd-d55d69565b15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67e521bd96c24057b4b5dfadbb3ab03e'} {{(pid=87086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:01.435682 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:01.441298 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG keystone.notifications [None req-d0eb3e19-0dbf-473b-8fcd-d55d69565b15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67e521bd96c24057b4b5dfadbb3ab03e'} {{(pid=87086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:01.447840 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: [pid: 87086|app: 0|req: 627/1255] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 16:34:01 2022] DELETE /identity/v3/users/67e521bd96c24057b4b5dfadbb3ab03e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:01.624501 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314d511-4692-4669-b0c2-da3b604be58a admin admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:01.625933 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-9314d511-4692-4669-b0c2-da3b604be58a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:01.641610 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314d511-4692-4669-b0c2-da3b604be58a admin admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:01.699989 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7205fc2-694c-49b3-b19a-8f892870a9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d80e0d318d4f78a4aac8c796957981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e89005d4d794906addd0b11c7e81008', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:01.700633 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7205fc2-694c-49b3-b19a-8f892870a9f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:01.700920 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7205fc2-694c-49b3-b19a-8f892870a9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:01.701200 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7205fc2-694c-49b3-b19a-8f892870a9f8 admin admin] PATH_INFO: `/v3/projects/fafb22d0bdc84b69bda971069fb49950` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:01.702372 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7205fc2-694c-49b3-b19a-8f892870a9f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fafb22d0bdc84b69bda971069fb49950)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:01.704345 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7205fc2-694c-49b3-b19a-8f892870a9f8 admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:01.750693 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-f7205fc2-694c-49b3-b19a-8f892870a9f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fafb22d0bdc84b69bda971069fb49950', 'request_id': 'req-f7205fc2-694c-49b3-b19a-8f892870a9f8'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:01.757324 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-f7205fc2-694c-49b3-b19a-8f892870a9f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fafb22d0bdc84b69bda971069fb49950', 'request_id': 'req-f7205fc2-694c-49b3-b19a-8f892870a9f8'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:01.762680 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-f7205fc2-694c-49b3-b19a-8f892870a9f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fafb22d0bdc84b69bda971069fb49950', 'request_id': 'req-f7205fc2-694c-49b3-b19a-8f892870a9f8'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:01.774352 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-f7205fc2-694c-49b3-b19a-8f892870a9f8 admin admin] The token cache is being invalidate because project fafb22d0bdc84b69bda971069fb49950 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:34:01.774640 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-f7205fc2-694c-49b3-b19a-8f892870a9f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:01.775261 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-f7205fc2-694c-49b3-b19a-8f892870a9f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:01.776809 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 629/1256] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 16:34:01 2022] DELETE /identity/v3/projects/fafb22d0bdc84b69bda971069fb49950 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:11.444539 dv-osbrick-849017-4-ceph devstack@keystone.service[87086]: DEBUG dbcounter [-] [87086] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=87086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:11.771467 dv-osbrick-849017-4-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=74,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}